The DOI matches its Crossref record; 48 of the 49 references it cites were found in a registry or an index.
Tools and Benchmarks for Automated Log Parsing
Open accessAbstract
Logs are imperative in the development and maintenance process of many software systems. They record detailed runtime information that allows developers and support engineers to monitor their systems and dissect anomalous behaviors and errors. The increasing scale and complexity of modern software systems, however, make the volume of logs explodes. In many cases, the traditional way of manual log inspection becomes impractical. Many recent studies, as well as industrial tools, resort to powerful text search and machine learning-based analytics solutions. Due to the unstructured nature of logs, a first crucial step is to parse log messages into structured data for subsequent analysis. In recent years, automated log parsing has been widely studied in both academia and industry, producing a series of log parsers by different techniques. To better understand the characteristics of these log parsers, in this paper, we present a comprehensive evaluation study on automated log parsing and further release the tools and benchmarks for easy reuse. More specifically, we evaluate 13 log parsers on a total of 16 log datasets spanning distributed systems, supercomputers, operating systems, mobile systems, server applications, and standalone software. We report the benchmarking results in terms of accuracy, robustness, and efficiency, which are of practical importance when deploying automated log parsing in production. We also share the success stories and lessons learned in an industrial application at Huawei. We believe that our work could serve as the basis and provide valuable guidance to future research and deployment of automated log parsing.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“While computationally lightweight, these methods struggle to adapt to evolving workloads and often suffer from high false-positive rates when applied to complex, real-world clusters.”
From LINEADAPTER: Parameter-Efficient Fine-Tuning for Log Anomaly Detection and Root Cause Analysis (2025) · cites this paper as [5]
Experimental — accuracy not yet measuredThe check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“pretraining contamination can silently inflate benchmark performance, and contamination checks are now part of mainstream LLM evaluation practice [147], [44], [139].”
From Large language models for agentic NetOps and AIOps: Architectures, evaluation, and safety (2027) · cites this paper as [147]
Experimental — accuracy not yet measuredThe check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“LLM graders can help with structure and readability, but they are not a substitute for tool-grounded correctness and safety scoring.”
From Large language models for agentic NetOps and AIOps: Architectures, evaluation, and safety (2027) · cites this paper as [147]
Experimental — accuracy not yet measuredThe check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“This frequencyratio-based heuristic has been widely adopted in prior work on log anomaly detection, particularly in template blacklisting and rule construction [4], [5].”
From LINEADAPTER: Parameter-Efficient Fine-Tuning for Log Anomaly Detection and Root Cause Analysis (2025) · cites this paper as [5]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
DeepLog: Anomaly Detection and Diagnosis from System Logs through Deep Learning
Du, M., Li, F., Zheng, G., & Srikumar, V. (2017) · Proceedings of the 2017 ACM SIGSAC Conference on Computer and Communications Security · doi:10.1145/3133956.3134015 · Cited by 1,835
Detecting large-scale system problems by mining console logs
Xu, W., Huang, L., Fox, A., Patterson, D., & Jordan, M. I. (2009) · Proceedings of the ACM SIGOPS 22nd symposium on Operating systems principles · doi:10.1145/1629575.1629587 · Cited by 1,332
Drain: an online log parsing approach with fixed depth tree
He, P., Zhu, J., Zheng, Z., & Lyu, M. R. (2017) · 2017 IEEE International Conference on Web Services (ICWS) · doi:10.1109/icws.2017.13 · Cited by 943
Self-citationWhat Supercomputers Say: A Study of Five System Logs
Oliner, A. J., & Stearley, J. (2007) · International Conference on Dependable Systems & Networks/Proceedings · doi:10.1109/dsn.2007.103 · Cited by 695
Experience Report: System Log Analysis for Anomaly Detection
He, S., Zhu, J., He, P., & Lyu, M. R.-T. (2016) · Proceedings/Proceedings - International Symposium on Software Reliability Engineering · doi:10.1109/issre.2016.21 · Cited by 675
Self-citationUsing magpie for request extraction and workload modelling
Barham, P., Donnelly, A., Isaacs, R., & Mortier, R. (2004) · Operating Systems Design and Implementation · Cited by 571
Execution Anomaly Detection in Distributed Systems through Unstructured Log Analysis
Fu, Q., Lou, J., Wang, Y., & Jiang, L. (2009) · Proceedings · doi:10.1109/icdm.2009.60 · Cited by 555
Log clustering based problem identification for online service systems
Lin, Q., Zhang, H., Lou, J., Zhang, Y., & Chen, X. (2016) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1145/2889160.2889232 · Cited by 493
A data clustering algorithm for mining patterns from event logs
Vaarandi, R. (2004) · IP Operations and Management · doi:10.1109/ipom.2003.1251233 · Cited by 480
Spell: Streaming Parsing of System Event Logs
Du, M., & Li, F. (2016) · 2016 IEEE 16th International Conference on Data Mining (ICDM) · doi:10.1109/icdm.2016.0103 · Cited by 423
Research works printed but not linked: 12
- 0, New automated log parsing
- 0, Logz io
- 0, Overview of logs-based metrics
- 0, Loghub A collection of system log datasets for intelligent log analysis
- 0, Automated root cause analysis for spark application failures
- 0, Log Management Service in the Cloud-Loggly
- 0, Log parsing - automated easy to use and efficient
- 0, Splunk
- 0, ElK
- 0, Logentries
- 0, A beginner? guide to logstash grok
- 0, Automated parsing log types
Cited by
Sorted by citations
Robust log-based anomaly detection on unstable log data
Zhang, X., Xu, Y., Lin, Q., Qiao, B., Zhang, H., Dang, Y., Xie, C., Yang, X., Cheng, Q., Li, Z., et al. (2019) · Proceedings of the 2019 27th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering · doi:10.1145/3338906.3338931 · Cited by 761
Log-based Anomaly Detection Without Log Parsing
Le, V.-H., & Zhang, H. (2021) · 2021 36th IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1109/ase51524.2021.9678773 · Cited by 361
“Log parsers could produce inconsistent results depend on the preprocessing step and the set of parameters [16], [15].”
MethodInfluentialLoghub: a large collection of system log datasets for AI-driven log analytics
Zhu, J., He, S., He, P., Liu, J., & Lyu, M. R. (2023) · 2023 IEEE 34th International Symposium on Software Reliability Engineering (ISSRE) · doi:10.1109/issre59848.2023.00071 · Cited by 302
Self-citationSemi-Supervised Log-Based Anomaly Detection via Probabilistic Label Estimation
Yang, L., Chen, J., Wang, Z., Wang, W., Jiang, J., Dong, X., & Zhang, W. (2021) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1109/icse43902.2021.00130 · Cited by 276
Log-based anomaly detection with deep learning: how far are we?
Le, V.-H., & Zhang, H. (2022) · Proceedings of the 44th International Conference on Software Engineering · doi:10.1145/3510003.3510155 · Cited by 257
HitAnomaly: Hierarchical Transformers for Anomaly Detection in System Log
Huang, S., Liu, Y., Fung, C., He, R., Zhao, Y., Yang, H., & Luan, Z. (2020) · IEEE Transactions on Network and Service Management · doi:10.1109/tnsm.2020.3034647 · Cited by 250
Deep learning for anomaly detection in log data: A survey
Landauer, M., Onder, S., Skopik, F., & Wurzenberger, M. (2023) · Machine Learning with Applications · doi:10.1016/j.mlwa.2023.100470 · Cited by 286
Self-Attentive Classification-Based Anomaly Detection in Unstructured Logs
Nedelkoski, S., Bogatinovski, J., Acker, A., Cardoso, J., & Kao, O. (2020) · 2020 IEEE International Conference on Data Mining (ICDM) · doi:10.1109/icdm50108.2020.00148 · Cited by 176
Logram: Efficient Log Parsing Using n-Gram Dictionaries
Dai, H., Li, H., Chen, C. S., Shang, W., & Chen, T.-H. P. (2020) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2020.3007554 · Cited by 175
SwissLog: Robust and Unified Deep Learning Based Log Anomaly Detection for Diverse Faults
Li, X., Chen, P., Jing, L., He, Z., & Yu, G. (2020) · Proceedings/Proceedings - International Symposium on Software Reliability Engineering · doi:10.1109/issre5003.2020.00018 · Cited by 166
UniParser: A Unified Log Parser for Heterogeneous Log Data
Liu, Y., Zhang, X., He, S., Zhang, H., Li, L., Kang, Y., Xu, Y. D., Ma, M., Lin, Q., Dang, Y., et al. (2022) · International World Wide Web Conference (WWW) · doi:10.1145/3485447.3511993 · Cited by 134
Self-citationLog Parsing with Prompt-based Few-shot Learning
Le, V.-H., & Zhang, H. (2023) · 2023 IEEE/ACM 45th International Conference on Software Engineering (ICSE) · doi:10.1109/icse48619.2023.00204 · Cited by 129
LILAC: Log Parsing using LLMs with Adaptive Parsing Cache
Jiang, Z., Liu, J., Chen, Z., Li, Y., Huang, J., Huo, Y., He, P., Gu, J., & Lyu, M. R.-T. (2024) · Proceedings of the ACM on software engineering. · doi:10.1145/3643733 · Cited by 148
Self-citationUnsupervised log message anomaly detection
Farzad, A., & Gulliver, T. A. (2020) · ICT Express · doi:10.1016/j.icte.2020.06.003 · Cited by 135
LogTransfer: Cross-System Log Anomaly Detection for Software Systems with Transfer Learning
Chen, R., Zhang, S., Li, D., Zhang, Y., Guo, F., Meng, W., Pei, D., Zhang, Y., Chen, X., & Liu, Y. (2020) · Proceedings/Proceedings - International Symposium on Software Reliability Engineering · doi:10.1109/issre5003.2020.00013 · Cited by 112
System log clustering approaches for cyber security applications: A survey
Landauer, M., Skopik, F., Wurzenberger, M., & Rauber, A. (2020) · Computers & Security · doi:10.1016/j.cose.2020.101739 · Cited by 118
LogEvent2vec: LogEvent-to-Vector Based Anomaly Detection for Large-Scale Logs in Internet of Things
Wang, J., Tang, Y., He, S., Zhao, C., Sharma, P. K., Alfarraj, O., & Tolba, A. K. R. (2020) · Sensors · doi:10.3390/s20092451 · Cited by 109
Self-citationLogzip: Extracting Hidden Structures via Iterative Clustering for Log Compression
Liu, J., Zhu, J., He, S., He, P., Zheng, Z., & Lyu, M. R.-T. (2019) · IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1109/ase.2019.00085 · Cited by 102
Self-citationBrain: Log Parsing With Bidirectional Parallel Tree
Yu, S., He, P., Chen, N., & Wu, Y. (2023) · IEEE Transactions on Services Computing · doi:10.1109/tsc.2023.3270566 · Cited by 102
Self-citationPrediction and Detection of FDIA and DDoS Attacks in 5G Enabled IoT
Moudoud, H., Khoukhi, L., & Cherkaoui, S. (2020) · IEEE Network · doi:10.1109/mnet.011.2000449 · Cited by 100
Zuo, Y., Wu, Y., Min, G., Huang, C., & Pei, K. (2020) · IEEE Transactions on Cognitive Communications and Networking · doi:10.1109/tccn.2020.2966615 · Cited by 94
Identifying bad software changes via multimodal anomaly detection for online service systems
Zhao, N., Chen, J., Yu, Z., Wang, H., Li, J., Qiu, B., Hong-yu, X., Zhang, W., Sui, K., & Pei, D. (2021) · ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE) · doi:10.1145/3468264.3468543 · Cited by 97
LLMParser: An Exploratory Study on Using Large Language Models for Log Parsing
Ma, Z., Chen, A. R., Kim, D. J., Chen, T.-H. P., & Wang, S. (2024) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1145/3597503.3639150 · Cited by 119
Guidelines for assessing the accuracy of log message template identification techniques
Khan, Z. A., Shin, D., Bianculli, D., & Briand, L. (2022) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1145/3510003.3510101 · Cited by 91
BERT-Log: Anomaly Detection for System Logs Based on Pre-trained Language Model
Chen, S., & Liao, H. (2022) · Applied Artificial Intelligence · doi:10.1080/08839514.2022.2145642 · Cited by 107
A Large-Scale Evaluation for Log Parsing Techniques: How Far Are We?
Jiang, Z., Liu, J., Huang, J., Li, Y., Huo, Y., Gu, J., Chen, Z., Zhu, J., & Lyu, M. R.-T. (2024) · ACM SIGSOFT International Symposium on Software Testing and Analysis (ISSTA) · doi:10.1145/3650212.3652123 · Cited by 99
Self-citationLog-Based Anomaly Detection With Robust Feature Extraction and Online Learning
Han, S., Wu, Q., Zhang, H., Qin, B., Hu, J., Shi, X., Liu, L., & Yin, X. (2021) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2021.3053371 · Cited by 88
Root-Cause Metric Location for Microservice Systems via Log Anomaly Detection
Wang, L., Zhao, N., Chen, J., Li, P., Zhang, W., & Sui, K. (2020) · 2020 IEEE International Conference on Web Services (ICWS) · doi:10.1109/icws49710.2020.00026 · Cited by 84
SwissLog: Robust Anomaly Detection and Localization for Interleaved Unstructured Logs
Li, X., Chen, P., Jing, L., He, Z., & Yu, G. (2022) · IEEE Transactions on Dependable and Secure Computing · doi:10.1109/tdsc.2022.3162857 · Cited by 83
Zhang, T., Qiu, H., Castellano, G., Rifai, M., Chen, C. S., & Pianese, F. (2023) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2022.3222417 · Cited by 96
DivLog: Log Parsing with Prompt Enhanced In-Context Learning
Xu, J., Yang, R., Huo, Y., Zhang, C., & He, P. (2024) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1145/3597503.3639155 · Cited by 111
Self-citationAnomaly Detection in the Open World: Normality Shift Detection, Explanation, and Adaptation
Han, D., Wang, Z., Chen, W., Wang, K., Yu, R., Wang, S., Zhang, H., Wang, Z., Jin, M., Yang, J., et al. (2023) · Network and Distributed System Security Symposium · doi:10.14722/ndss.2023.24830 · Cited by 83
An empirical investigation of practical log anomaly detection for online service systems
Zhao, N., Wang, H., Li, Z., Peng, X., Wang, G., Pan, Z., Wu, Y., Feng, Z., Wen, X., Zhang, W., et al. (2021) · Proceedings of the 29th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering · doi:10.1145/3468264.3473933 · Cited by 77
Experience Report: Deep Learning-based System Log Analysis for Anomaly DetectionPreprint
Chen, Z., Liu, J., Gu, W., Su, Y., & Lyu, M. R.-T. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2107.05908 · Cited by 187
Self-citationNedelkoski, S., Bogatinovski, J., Acker, A., Cardoso, J., & Kao, O. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-67667-4_8 · Cited by 78
A systematic literature review on automated log abstraction techniques
El-Masri, D., Petrillo, F. D. S., Guéhéneuc, Y., Hamou‐Lhadj, A., & Bouziane, A. (2020) · Information and Software Technology · doi:10.1016/j.infsof.2020.106276 · Cited by 74
Heterogeneous Anomaly Detection for Software Systems via Semi-supervised Cross-modal Attention
Lee, C., Yang, T., Chen, Z., Su, Y., Yang, Y., & Lyu, M. R. (2023) · 2023 IEEE/ACM 45th International Conference on Software Engineering (ICSE) · doi:10.1109/icse48619.2023.00148 · Cited by 68
Self-citationAnomaly Detection in Operating System Logs with Deep Learning-Based Sentiment Analysis
Studiawan, H., Sohel, F. A., & Payne, C. (2020) · IEEE Transactions on Dependable and Secure Computing · doi:10.1109/tdsc.2020.3037903 · Cited by 69
PLELog: Semi-Supervised Log-Based Anomaly Detection via Probabilistic Label Estimation
Yang, L., Chen, J., Wang, Z., Wang, W., Jiang, J., Dong, X., & Zhang, W. (2021) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1109/icse-companion52605.2021.00106 · Cited by 72
A Semantic-aware Representation Framework for Online Log Analysis
Meng, W., Liu, Y., Huang, Y., Zhang, S., Zaiter, F., Chen, B. J., & Pei, D. (2020) · International Conference on Computer Communications and Networks (ICCCN) · doi:10.1109/icccn49398.2020.9209707 · Cited by 72
Deep Learning or Classical Machine Learning? An Empirical Study on Log-Based Anomaly Detection
Yu, B., Yao, J., Fu, Q., Zhong, Z., Xie, H., Wu, Y., Ma, Y., & He, P. (2024) · Proceedings of the IEEE/ACM 46th International Conference on Software Engineering · doi:10.1145/3597503.3623308 · Cited by 65
Self-citationLogEncoder: Log-Based Contrastive Representation Learning for Anomaly Detection
Qi, J., Luan, Z., Huang, S., Fung, C., Yang, H., Li, H., Zhu, D., & Qian, D. (2023) · IEEE Transactions on Network and Service Management · doi:10.1109/tnsm.2023.3239522 · Cited by 69
A Survey on Log Anomaly Detection using Deep Learning
Yadav, R. B., Kumar, P., & Dhavale, S. (2020) · International Conference on Reliability, Infocom Technologies and Optimization (Trends and Future Directions) (ICRITO) · doi:10.1109/icrito48877.2020.9197818 · Cited by 68
LogParser-LLM: Advancing Efficient Log Parsing with Large Language Models
Zhong, A., Mo, D., Liu, G., Liu, J., Lu, Q., Zhou, Q., Wu, J., Li, Q., & Wen, Q. (2024) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3637528.3671810 · Cited by 66
Self-citationMulti-source Distributed System Data for AI-Powered Analytics
Nedelkoski, S., Bogatinovski, J., Mandapati, A. K., Becker, S., Cardoso, J., & Kao, O. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-44769-4_13 · Cited by 60
DeepSyslog: Deep Anomaly Detection on Syslog Using Sentence Embedding and Metadata
Zhou, J., Qian, Y., Zou, Q., Liu, P., & Xiang, J. (2022) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2022.3201379 · Cited by 64
Onion: identifying incident-indicating logs for cloud systems
Zhang, X., Xu, Y. D., Qin, S., He, S., Qiao, B., Li, Z., Zhang, H., Li, X., Dang, Y., Lin, Q., et al. (2021) · ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE) · doi:10.1145/3468264.3473919 · Cited by 59
Self-citationLogClass: Anomalous Log Identification and Classification With Partial Labels
Meng, W., Liu, Y., Zhang, S., Zaiter, F., Zhang, Y., Huang, Y., Yu, Z., Zhang, Y., Song, L., Zhang, M., et al. (2021) · IEEE Transactions on Network and Service Management · doi:10.1109/tnsm.2021.3055425 · Cited by 56
ROSE: Robust Searchable Encryption With Forward and Backward Security
Xu, P., Susilo, W., Wang, W., Chen, T., Wu, Q., Liang, K., & Jin, H. (2022) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2022.3155977 · Cited by 55
LogGD: Detecting Anomalies from System Logs with Graph Neural Networks
Xie, Y., Zhang, H., & Babar, M. A. (2022) · IEEE International Conference on Software Quality, Reliability and Security (QRS) · doi:10.1109/qrs57517.2022.00039 · Cited by 72
Interpretable Online Log Analysis Using Large Language Models with Prompt Strategies
Liu, Y., Tao, S., Meng, W., Wang, J., Ma, W., Chen, Y., Zhao, Y., Yang, H., & Jiang, Y. (2024) · IEEE International Conference on Program Comprehension (ICPC) · doi:10.1145/3643916.3644408 · Cited by 101
An empirical study of log analysis at Microsoft
He, S., Zhang, X., He, P., Xu, Y. D., Li, L., Kang, Y., Ma, M., Wei, Y., Dang, Y., Rajmohan, S., et al. (2022) · ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE) · doi:10.1145/3540250.3558963 · Cited by 53
Self-citationLog Parsing: How Far Can ChatGPT Go?
Le, V.-H., & Zhang, H. (2023) · IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1109/ase56229.2023.00206 · Cited by 68
Automatic Programming: Large Language Models and Beyond
Lyu, M. R.-T., Ray, B., Roychoudhury, A., Tan, S. H., & Thongtanunam, P. (2024) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3708519 · Cited by 83
Self-citationXia, B., Bai, Y., Yin, J., Li, Y., & Xu, J. (2020) · Information Systems Frontiers · doi:10.1007/s10796-020-10026-3 · Cited by 60
Did We Miss Something Important? Studying and Exploring Variable-Aware Log Abstraction
Li, Z., Luo, C., Chen, T.-H. P., Shang, W., He, S., Lin, Q., & Zhang, D. (2023) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1109/icse48619.2023.00078 · Cited by 56
Self-citationZhang, C., Wang, X., Zhang, H., Zhang, H., & Han, P. (2021) · IEEE Transactions on Network and Service Management · doi:10.1109/tnsm.2021.3125967 · Cited by 49
Impact of log parsing on deep learning-based anomaly detection
Khan, Z. A., Shin, D., Bianculli, D., & Briand, L. C. (2024) · Empirical Software Engineering · doi:10.1007/s10664-024-10533-w · Cited by 49
SPINE: a scalable log parser with feedback guidance
Wang, X., Zhang, X., Li, L., He, S., Zhang, H., Liu, Y., Zheng, L., Kang, Y., Lin, Q., Dang, Y., et al. (2022) · ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE) · doi:10.1145/3540250.3549176 · Cited by 49
Self-citationSelf-Supervised Anomaly Detection from Distributed Traces
Bogatinovski, J., Nedelkoski, S., Cardoso, J., & Kao, O. (2020) · 2020 IEEE/ACM 13th International Conference on Utility and Cloud Computing (UCC) · doi:10.1109/ucc48980.2020.00054 · Cited by 50
MLog: Mogrifier LSTM-Based Log Anomaly Detection Approach Using Semantic Representation
Fu, Y., Liang, K., & Xu, J. (2023) · IEEE Transactions on Services Computing · doi:10.1109/tsc.2023.3289488 · Cited by 49
LogParse: Making Log Parsing Adaptive through Word Classification
Meng, W., Liu, Y., Zaiter, F., Zhang, S., Chen, Y., Zhang, Y., Zhu, Y., Wang, E., Zhang, R., Tao, S., et al. (2020) · International Conference on Computer Communications and Networks (ICCCN) · doi:10.1109/icccn49398.2020.9209681 · Cited by 49
ALchemist: Fusing Application and Audit Logs for Precise Attack Provenance without Instrumentation
Yu, L., Ma, S., Zhang, Z., Tao, G., Zhang, X., Xu, D., Urias, V. E., Han, L., Ciocarlie, G. F., Yegneswaran, V., et al. (2021) · Network and Distributed System Security Symposium · doi:10.14722/ndss.2021.24445 · Cited by 47
LogAssist: Assisting Log Analysis Through Log Summarization
Locke, S., Li, H., Chen, T.-H., Shang, W., & Liu, W. (2022) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2021.3083715 · Cited by 45
LayerLog: Log sequence anomaly detection based on hierarchical semantics
Zhang, C., Wang, X., Zhang, H., Zhang, J., Zhang, H., Liu, C., & Han, P. (2022) · Applied Soft Computing · doi:10.1016/j.asoc.2022.109860 · Cited by 52
Loader: A Log Anomaly Detector Based on Transformer
Xiao, T. Y., Quan, Z., Wang, Z.-J., Le, Y., Du, Y., Liao, X., Li, K., & Li, K. (2023) · IEEE Transactions on Services Computing · doi:10.1109/tsc.2023.3280575 · Cited by 44
Tao, S., Meng, W., Cheng, Y., Zhu, Y., Liu, Y., Du, C., Han, T., Zhao, Y., Wang, X., & Yang, H. (2022) · ACM SIGMETRICS Performance Evaluation Review · doi:10.1145/3543146.3543168 · Cited by 47
MoniLog: An Automated Log-Based Anomaly Detection System for Cloud Computing Infrastructures
Vervaet, A. (2021) · IEEE International Conference on Data Engineering (ICDE) · doi:10.1109/icde51399.2021.00317 · Cited by 49
Building AI Agents for Autonomous Clouds: Challenges and Design Principles
Shetty, M., Chen, Y., Somashekar, G., Ma, M., Simmhan, Y. L., Zhang, X., Mace, J., Vandevoorde, D., Las-Casas, P., Gupta, S. M., et al. (2024) · ACM Symposium on Cloud Computing (SoCC) · doi:10.1145/3698038.3698525 · Cited by 54
PredictDeep: Security Analytics as a Service for Anomaly Detection and Prediction
Elsayed, M. A., & Zulkernine, M. (2020) · IEEE Access · doi:10.1109/access.2020.2977325 · Cited by 41
Improving Log-Based Anomaly Detection with Component-Aware Analysis
Yin, K., Yan, M., Xu, L., Xu, Z., Li, Z., Yang, D., & Zhang, X. (2020) · 2020 IEEE International Conference on Software Maintenance and Evolution (ICSME) · doi:10.1109/icsme46990.2020.00069 · Cited by 37
Robust and Transferable Anomaly Detection in Log Data using Pre-Trained Language Models
Ott, H., Bogatinovski, J., Acker, A., Nedelkoski, S., & Kao, O. (2021) · IEEE/ACM International Workshop on Cloud Intelligence (CloudIntelligence) · doi:10.1109/cloudintelligence52565.2021.00013 · Cited by 44
LogGT: Cross-system log anomaly detection via heterogeneous graph feature and transfer learning
Wang, P., Zhang, X., Cao, Z., Xu, W., & Li, W. (2024) · Expert Systems with Applications · doi:10.1016/j.eswa.2024.124082 · Cited by 44
Aarohi: Making Real-Time Node Failure Prediction Feasible
Das, A., Mueller, F., & Rountree, B. (2020) · IEEE International Parallel and Distributed Processing Symposium (IPDPS) · doi:10.1109/ipdps47924.2020.00115 · Cited by 38
Log-based software monitoring: a systematic mapping study
Cândido, J., Aniche, M. F., & Arie Van Deursen, A. (2021) · PeerJ Computer Science · doi:10.7717/peerj-cs.489 · Cited by 38
On the effectiveness of log representation for log-based anomaly detection
Wu, X., Li, H., & Khomh, F. (2023) · Empirical Software Engineering · doi:10.1007/s10664-023-10364-1 · Cited by 47
Anomaly Detection using Distributed Log Data: A Lightweight Federated Learning Approach
Guo, Y., Wu, Y., Zhu, Y., Yang, B., & Han, C. (2021) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn52387.2021.9533294 · Cited by 37
An empirical study of the impact of log parsers on the performance of log-based anomaly detection
Fu, Y., Yan, M. L., Xu, Z., Xia, X., Zhang, X., & Yang, D. (2022) · Empirical Software Engineering · doi:10.1007/s10664-022-10214-6 · Cited by 38
Wurzenberger, M., Höld, G., Landauer, M., & Skopik, F. (2023) · Computers & Security · doi:10.1016/j.cose.2023.103631 · Cited by 45
KnowLog: Knowledge Enhanced Pre-trained Language Model for Log Understanding
Ma, L., Yang, W., Xu, B., Jiang, S., Fei, B., Liang, J., Zhou, M., & Xiao, Y. (2024) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1145/3597503.3623304 · Cited by 45
QLLog: A log anomaly detection method based on Q-learning algorithm
Duan, X., Ying, S., Yuan, W., Cheng, H., & Yin, X. (2021) · Information Processing & Management · doi:10.1016/j.ipm.2021.102540 · Cited by 37
Setianto, F., Tsani, E., Sadiq, F., Domalis, G., Tsakalidis, D., & Kostakos, P. (2021) · IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining (ASONAM) · doi:10.1145/3487351.3492723 · Cited by 36
Anomaly Detection via Mining Numerical Workflow Relations from Logs
Zhang, B., Zhang, H., Moscato, P., & Zhang, A. (2020) · IEEE Symposium on Reliable Distributed Systems (SRDS) · doi:10.1109/srds51746.2020.00027 · Cited by 34
A study of the performance of general compressors on log files
Yao, K., Li, H., Shang, W., & Hassan, A. E. (2020) · Empirical Software Engineering · doi:10.1007/s10664-020-09822-x · Cited by 32
LPV: A Log Parser Based on Vectorization for Offline and Online Log Parsing
Xiao, T. Y., Quan, Z., Wang, Z.-J., Zhao, K., & Liao, X. (2020) · Proceedings · doi:10.1109/icdm50108.2020.00175 · Cited by 32
Research on anomaly detection and real-time reliability evaluation with the log of cloud platform
Wang, B., Hua, Q., Zhang, H., Tan, X. L., Nan, Y., Chen, R., & Shu, X. (2022) · Alexandria Engineering Journal · doi:10.1016/j.aej.2021.12.061 · Cited by 37
OneLog: towards end-to-end software log anomaly detection
Hashemi, S., & Mäntylä, M. (2024) · Automated Software Engineering · doi:10.1007/s10515-024-00428-x · Cited by 24
PreLog: A Pre-trained Model for Log Analytics
Le, V.-H., & Zhang, H. (2024) · Proceedings of the ACM on Management of Data · doi:10.1145/3654966 · Cited by 36
Landscape of Automated Log Analysis: A Systematic Literature Review and Mapping Study
Korzeniowski, Ł., & Goczyła, K. (2022) · IEEE Access · doi:10.1109/access.2022.3152549 · Cited by 34
LogLS: Research on System Log Anomaly Detection Method Based on Dual LSTM
Chen, Y., Luktarhan, N., & Lv, D. (2022) · Symmetry · doi:10.3390/sym14030454 · Cited by 33
Paddy: An Event Log Parsing Approach using Dynamic Dictionary
Huang, S., Liu, Y., Fung, C., He, R., Zhao, Y., Yang, H., & Luan, Z. (2020) · IEEE/IFIP Network Operations and Management Symposium (NOMS) · doi:10.1109/noms47738.2020.9110435 · Cited by 31
An Effective Approach for Parsing Large Log Files
Sedki, I., Hamou‐Lhadj, A., Mohamed, O. A., & Shehab, M. A. (2022) · IEEE International Conference on Software Maintenance (ICSM) · doi:10.1109/icsme55016.2022.00009 · Cited by 30
Investigating and improving log parsing in practice
Fu, Y., Yan, M. L., Xu, J., Li, J., Liu, Z., Zhang, X., & Yang, D. (2022) · ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE) · doi:10.1145/3540250.3558947 · Cited by 34
Improving State-of-the-Art Compression Techniques for Log Management Tools
Yao, K., Sayagh, M., Shang, W., & Hassan, A. E. (2021) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2021.3069958 · Cited by 29
Framework for automatic detection of anomalies in DevOps
Fawzy, A., Wassif, K. T., & Moussa, H. (2023) · Journal of King Saud University - Computer and Information Sciences · doi:10.1016/j.jksuci.2023.02.010 · Cited by 28
LogGAN: A Sequence-Based Generative Adversarial Network for Anomaly Detection Based on System Logs
Xia, B., Yin, J., Xu, J., & Li, Y. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-34637-9_5 · Cited by 29
Kratzke, N. (2022) · Future Internet · doi:10.3390/fi14100274 · Cited by 34
Robust and Transferable Log-based Anomaly Detection
Jia, P., Cai, S., Ooi, B. C., Wang, P., & Xiong, Y. (2023) · Proceedings of the ACM on Management of Data · doi:10.1145/3588918 · Cited by 36
An Assessment of ChatGPT on Log Data
Mudgal, P., & Wouhaybi, R. H. (2023) · Communications in computer and information science · doi:10.1007/978-981-99-7587-7_13 · Cited by 37
Studying the use of Java logging utilities in the wild
Chen, B., & Jiang, Z. M. (2020) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1145/3377811.3380408 · Cited by 28
Metadata
- Authors
- Zhu, J., He, S., Liu, J., He, P., Xie, Q., Zheng, Z., & Lyu, M. R.
- Affiliations
- Huawei Technologies (China) (CN)
- Chinese University of Hong Kong (HK)
- Sun Yat-sen University (CN)
- ETH Zurich (CH)
- Southwest Minzu University (CN)
- Venue
- 2019 IEEE/ACM 41st International Conference on Software Engineering: Software Engineering in Practice (ICSE-SEIP)
- Publisher
- IEEE
- Published
- 2019-05
- Pages
- 121-130
- OpenAlex
- W2963999143
- Cited by
- 574
- References
- 49
- Citations by year
- 2026: 57 · 2025: 86 · 2024: 108 · 2023: 92 · 2022: 62 · 2021: 89 · 2020: 65 · 2019: 15
- FWCI
- 49.91
- Type
- conference paper
- Language
- en
- Open access
- green
- arxiv.org
- Licence
- Locations
- IEEE/ACM International Conference on Software Engineering: Software Engineering in Practice (ICSE-SEIP) (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Funders
- National Natural Science Foundation of China (61332010, 61502401, 61722214)
- Chinese University of Hong Kong (14210717)
- Topics
- Physical Sciences › Computer Science › Computer Networks and Communications › Software System Performance and Reliability
- Physical Sciences › Computer Science › Information Systems › Software Engineering Research
- Physical Sciences › Computer Science › Information Systems › Software Engineering Techniques and Practices
- Keywords
- benchmarking, structured data extraction
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review