Log-based anomaly detection with deep learning: how far are we?
Open accessThe DOI matches its Crossref record; 57 of the 57 references it cites were found in a registry or an index.
Abstract
Software-intensive systems produce logs for troubleshooting purposes. Recently, many deep learning models have been proposed to automatically detect system anomalies based on log data. These models typically claim very high detection accuracy. For example, most models report an F-measure greater than 0.9 on the commonly-used HDFS dataset. To achieve a profound understanding of how far we are from solving the problem of log-based anomaly detection, in this paper, we conduct an in-depth analysis of five state-of-the-art deep learning-based models for detecting system anomalies on four public log datasets. Our experiments focus on several aspects of model evaluation, including training data selection, data grouping, class distribution, data noise, and early detection ability. Our results point out that all these aspects have significant impact on the evaluation, and that all the studied models do not always work well. The problem of log-based anomaly detection has not been solved yet. Based on our findings, we also suggest possible future work.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Extensive machine learning and deep learning-based techniques have been proposed in research for automated log anomaly detection [9], [10], with the aim of reducing manual analysis costs.”
From Practitioners’ expectations on log anomaly detection (2025) · cites this paper as [10]
Experimental — accuracy not yet measuredThe check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“However, the adoption of LLM agents in the AIOps field, especially with noisy and lengthy data, remains limited [21,28].”
From RCAgent: Cloud Root Cause Analysis by Autonomous Agents with Tool-Augmented Large Language Models (2024) · cites this paper as [21]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404 · cited 1×
“For example, Logsy [39] utilizes the Transformer network [46] to detect anomalies from log data.”
MethodExploiting Generative AI to Scale up Intelligent Tutoring Systems
Jakubův, J., Chvalovský, K., Goertzel, Z., Kaliszyk, C., Olšák, M., Piotrowski, B., Schulz, S., Suda, M., & Urban, J. (2023) · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · doi:10.4230/lipics.itp.2023.19 · Cited by 76,658
Glove: Global Vectors for Word Representation
Pennington, J., Socher, R., & Manning, C. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1162 · Cited by 34,071 · cited 1×
“PLELog extracts the semantic vectors of log templates by using a pre-trained Glovemodel [41].”
MethodLearning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation
Cho, K., van Merrienboer, B., Gulcehre, C., Bahdanau, D., Bougares, F., Schwenk, H., & Bengio, Y. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1179 · Cited by 25,545 · cited 1×
“Recurrent Neural Networks (RNNs), including its variants Long Short-Term Memory (LSTM) [21] and Gated Recurrent Units (GRUs) [9], are neural networks designed to handle the sequential inputs with arbitrary length.”
BackgroundConvolutional Neural Networks for Sentence Classification
Kim, Y. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1181 · Cited by 14,831 · cited 1×
“In [33], a CNN model originally designed for sentence classification [25] is applied to log-based anomaly detection.”
MethodLearning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translation
Cho, K., van Merrienboer, B., Gulcehre, C., Bahdanau, D., Bougares, F., Schwenk, H., & Bengio, Y. (2014) · arXiv · doi:10.48550/arxiv.1406.1078 · Cited by 3,317 · cited 1×
“Recurrent Neural Networks (RNNs), including its variants Long Short-Term Memory (LSTM) [21] and Gated Recurrent Units (GRUs) [9], are neural networks designed to handle the sequential inputs with arbitrary length.”
Backgroundhdbscan: Hierarchical density based clustering
McInnes, L., Healy, J., & Astels, S. (2017) · The Journal of Open Source Software · doi:10.21105/joss.00205 · Cited by 2,833 · cited 2×
“PLELog adopts a clustering method (i.e., HDBSCAN [35]) to probabilistically estimate the labels of unlabeled log sequences.”
BackgroundBeyond Accuracy, F-Score and ROC: A Family of Discriminant Measures for Performance Evaluation
Sokolova, M., Japkowicz, N., & Szpakowicz, S. (2006) · Lecture Notes in Computer Science · doi:10.1007/11941439_114 · Cited by 1,974 · cited 1×
“Specificity [43, 49], which is the percentage of log sequences that are correctly identified normal over all real normal sequences, can measure the probability of false alarms.”
BackgroundDeepLog: Anomaly Detection and Diagnosis from System Logs through Deep Learning
Du, M., Li, F., Zheng, G., & Srikumar, V. (2017) · Proceedings of the 2017 ACM SIGSAC Conference on Computer and Communications Security · doi:10.1145/3133956.3134015 · Cited by 1,835 · cited 10×
“To answer the above questions, we conduct a systematic evaluation of five representative deep learning models for log-based anomaly detection (including DeepLog [12], LogAnomaly [36], PLELog [48], LogRobust [54], and CNN [33]) on four datasets (including HDFS, BGL, Spirit, and Thunderbird), under controlled experiment…”
BackgroundMethodInfluentialDetecting large-scale system problems by mining console logs
Xu, W., Huang, L., Fox, A., Patterson, D., & Jordan, M. I. (2009) · Proceedings of the ACM SIGOPS 22nd symposium on Operating systems principles · doi:10.1145/1629575.1629587 · Cited by 1,332 · cited 1×
“Over the years, many data-driven methods have been proposed to automatically detect system anomalies by analyzing log data [6, 7, 12, 29, 47, 50, 54].”
Drain: an online log parsing approach with fixed depth tree
He, P., Zhu, J., Zheng, Z., & Lyu, M. R. (2017) · 2017 IEEE International Conference on Web Services (ICWS) · doi:10.1109/icws.2017.13 · Cited by 943 · cited 5×
“There are many log parsing techniques, based on frequent pattern mining [10, 38, 45], clustering [16, 42, 44], and heuristics [17, 22, 34].”
MethodInfluentialFastText.zip: Compressing text classification models
Joulin, A., Grave, E., Bojanowski, P., Douze, M., Jégou, H., & Mikolov, T. (2016) · arXiv · doi:10.48550/arxiv.1612.03651 · Cited by 887 · cited 7×
“We adopt the pre-trained FastText [23] model to compute the semantic vectors for LogRobust and CNN.”
MethodInfluentialRobust log-based anomaly detection on unstable log data
Zhang, X., Xu, Y., Lin, Q., Qiao, B., Zhang, H., Dang, Y., Xie, C., Yang, X., Cheng, Q., Li, Z., et al. (2019) · Proceedings of the 2019 27th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering · doi:10.1145/3338906.3338931 · Cited by 761 · cited 10×
“To answer the above questions, we conduct a systematic evaluation of five representative deep learning models for log-based anomaly detection (including DeepLog [12], LogAnomaly [36], PLELog [48], LogRobust [54], and CNN [33]) on four datasets (including HDFS, BGL, Spirit, and Thunderbird), under controlled experiment…”
BackgroundMethodInfluentialSelf-citationLogAnomaly: Unsupervised Detection of Sequential and Quantitative Anomalies in Unstructured Logs
Meng, W., Liu, Y., Zhu, Y., Zhang, S., Pei, D., Liu, Y., Chen, Y., Zhang, R., Tao, S., Sun, P., et al. (2019) · Proceedings of the Twenty-Eighth International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2019/658 · Cited by 708 · cited 10×
“To answer the above questions, we conduct a systematic evaluation of five representative deep learning models for log-based anomaly detection (including DeepLog [12], LogAnomaly [36], PLELog [48], LogRobust [54], and CNN [33]) on four datasets (including HDFS, BGL, Spirit, and Thunderbird), under controlled experiment…”
BackgroundMethodInfluentialQuantitative analysis of faults and failures in a complex software system
Fenton, N. E., & Ohlsson, N. (2000) · IEEE Transactions on Software Engineering · doi:10.1109/32.879815 · Cited by 699
What Supercomputers Say: A Study of Five System Logs
Oliner, A., & Stearley, J. (2007) · 37th Annual IEEE/IFIP International Conference on Dependable Systems and Networks (DSN'07) · doi:10.1109/dsn.2007.103 · Cited by 620 · cited 6×
“• BGL (Blue Gene/L) dataset is a supercomputing system log dataset collected by Lawrence Livermore National Labs (LLNL) [40].”
MethodInfluentialExperience Report: System Log Analysis for Anomaly Detection
He, S., Zhu, J., He, P., & Lyu, M. R. (2016) · 2016 IEEE 27th International Symposium on Software Reliability Engineering (ISSRE) · doi:10.1109/issre.2016.21 · Cited by 593 · cited 5×
“The main purpose of this step is to separate logs into various groups, where each group represents a finite chunk of logs [19].”
BackgroundMethodInfluentialTools and benchmarks for automated log parsing
Zhu, J., He, S., Liu, J., He, P., Xie, Q., Zheng, Z., & Lyu, M. R. (2019) · 2019 IEEE/ACM 41st International Conference on Software Engineering: Software Engineering in Practice (ICSE-SEIP) · doi:10.1109/icse-seip.2019.00021 · Cited by 574 · cited 2×
“The heuristics-based approaches make use of the characteristics of logs and have been found to perform better than other techniques in terms of accuracy and time efficiency [55].”
BackgroundMethodYerushalmy, J. (1947) · Public Health Reports (1896-1970) · doi:10.2307/4586294 · Cited by 465 · cited 1×
“Specificity [43, 49], which is the percentage of log sequences that are correctly identified normal over all real normal sequences, can measure the probability of false alarms.”
BackgroundLogBERT: Log Anomaly Detection via BERT
Guo, H., Yuan, S., & Wu, X. (2021) · 2021 International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn52387.2021.9534113 · Cited by 454 · cited 3×
“It has been applied in [15, 26, 39] for log-based anomaly detection.”
MethodFailure diagnosis using decision trees
Chen, M., Zheng, A. X., Lloyd, J., Jordan, M. I., & Brewer, E. (2004) · International Conference on Autonomic Computing, 2004. Proceedings. · doi:10.1109/icac.2004.1301345 · Cited by 433
Log clustering based problem identification for online service systems
Lin, Q., Zhang, H., Lou, J.-G., Zhang, Y., & Chen, X. (2016) · Proceedings of the 38th International Conference on Software Engineering Companion · doi:10.1145/2889160.2889232 · Cited by 427 · cited 1×
“Over the years, many data-driven methods have been proposed to automatically detect system anomalies by analyzing log data [6, 7, 12, 29, 47, 50, 54].”
Self-citationSpell: Streaming Parsing of System Event Logs
Du, M., & Li, F. (2016) · 2016 IEEE 16th International Conference on Data Mining (ICDM) · doi:10.1109/icdm.2016.0103 · Cited by 423 · cited 4×
“The results on BGL and Spirit datasets show that DeepLog and LogAnomaly perform better with Spell [11] and IPLoM [34] than with Drain.”
MethodInfluentialLog-based Anomaly Detection Without Log Parsing
Le, V.-H., & Zhang, H. (2021) · 2021 36th IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1109/ase51524.2021.9678773 · Cited by 361 · cited 5×
“[26] found that log parsing errors can lead to many incorrect log events, thus downgrading anomaly detection performance.”
BackgroundMethodInfluentialSelf-citationClustering event logs using iterative partitioning
Makanju, A. A. O., Zincir-Heywood, A. N., & Milios, E. E. (2009) · Proceedings of the 15th ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/1557019.1557154 · Cited by 338 · cited 7×
“There are many log parsing techniques, based on frequent pattern mining [10, 38, 45], clustering [16, 42, 44], and heuristics [17, 22, 34].”
MethodInfluentialA Survey on Automated Log Analysis for Reliability Engineering
He, S., He, P., Chen, Z., Yang, T., Su, Y., & Lyu, M. R. (2022) · ACM Computing Surveys · doi:10.1145/3460345 · Cited by 334 · cited 1×
“Log data is usually unstructured text messages, which can help engineers understand the system’s internal status and facilitate monitoring, administering, and troubleshooting of the system [18].”
BackgroundLiu, F., Wen, Y., Zhang, D., Jiang, X., Xing, X., & Meng, D. (2019) · Proceedings of the 2019 ACM SIGSAC Conference on Computer and Communications Security · doi:10.1145/3319535.3363224 · Cited by 319 · cited 1×
“relationships among logging components [30], to capture a variety of anomalous behavior.”
BackgroundMining invariants from console logs for system problem detection
Lou, J., Fu, Q., Yang, S., Xu, Y., & Li, J. (2010) · Cited by 302
Loghub: a large collection of system log datasets for AI-driven log analytics
Zhu, J., He, S., He, P., Liu, J., & Lyu, M. R. (2023) · 2023 IEEE 34th International Symposium on Software Reliability Engineering (ISSRE) · doi:10.1109/issre59848.2023.00071 · Cited by 302
LogCluster - A data clustering and pattern mining algorithm for event logs
Vaarandi, R., & Pihelgas, M. (2015) · 2015 11th International Conference on Network and Service Management (CNSM) · doi:10.1109/cnsm.2015.7367331 · Cited by 246 · cited 1×
“There are many log parsing techniques, based on frequent pattern mining [10, 38, 45], clustering [16, 42, 44], and heuristics [17, 22, 34].”
MethodLogSig: generating system events from raw textual logs
Tang, L., Li, T., & Perng, C.-S. (2011) · Proceedings of the 20th ACM international conference on Information and knowledge management · doi:10.1145/2063576.2063690 · Cited by 244 · cited 1×
“There are many log parsing techniques, based on frequent pattern mining [10, 38, 45], clustering [16, 42, 44], and heuristics [17, 22, 34].”
MethodSemi-Supervised Log-Based Anomaly Detection via Probabilistic Label Estimation
Yang, L., Chen, J., Wang, Z., Wang, W., Jiang, J., Dong, X., & Zhang, W. (2021) · 2021 IEEE/ACM 43rd International Conference on Software Engineering (ICSE) · doi:10.1109/icse43902.2021.00130 · Cited by 244 · cited 4×
“[48] addressed the issue of insufficient labels via probabilistic label estimation and designed an attention-based GRU neural network to detect anomalies.”
BackgroundMethodInfluentialLogMine: Fast Pattern Recognition for Log Analytics
Hamooni, H., Debnath, B., Xu, J., Zhang, H., Jiang, G., & Mueen, A. (2016) · Proceedings of the 25th ACM International on Conference on Information and Knowledge Management · doi:10.1145/2983323.2983358 · Cited by 227 · cited 1×
“There are many log parsing techniques, based on frequent pattern mining [10, 38, 45], clustering [16, 42, 44], and heuristics [17, 22, 34].”
MethodSelf-citationDetecting Anomaly in Big Data System Logs Using Convolutional Neural Network
Lu, S., Wei, X., Li, Y., & Wang, L. (2018) · 2018 IEEE 16th Intl Conf on Dependable, Autonomic and Secure Computing, 16th Intl Conf on Pervasive Intelligence and Computing, 4th Intl Conf on Big Data Intelligence and Computing and Cyber Science and Technology Congress(DASC/PiCom/DataCom/CyberSciTech) · doi:10.1109/dasc/picom/datacom/cyberscitec.2018.00037 · Cited by 220 · cited 6×
“To answer the above questions, we conduct a systematic evaluation of five representative deep learning models for log-based anomaly detection (including DeepLog [12], LogAnomaly [36], PLELog [48], LogRobust [54], and CNN [33]) on four datasets (including HDFS, BGL, Spirit, and Thunderbird), under controlled experiment…”
MethodInfluentialMi, H., Wang, H., Zhou, Y., Lyu, M. R.-T., & Cai, H. (2013) · IEEE Transactions on Parallel and Distributed Systems · doi:10.1109/tpds.2013.21 · Cited by 176 · cited 1×
“produce about 30-50 gigabytes (around 120-200 million lines) of tracing logs per hour [37].”
BackgroundSelf-Attentive Classification-Based Anomaly Detection in Unstructured Logs
Nedelkoski, S., Bogatinovski, J., Acker, A., Cardoso, J., & Kao, O. (2020) · 2020 IEEE International Conference on Data Mining (ICDM) · doi:10.1109/icdm50108.2020.00148 · Cited by 176 · cited 3×
“It has been applied in [15, 26, 39] for log-based anomaly detection.”
BackgroundMethodAbstracting log lines to log event types for mining software system logs
Nagappan, M., & Vouk, M. A. (2010) · 2010 7th IEEE Working Conference on Mining Software Repositories (MSR 2010) · doi:10.1109/msr.2010.5463281 · Cited by 171 · cited 1×
“There are many log parsing techniques, based on frequent pattern mining [10, 38, 45], clustering [16, 42, 44], and heuristics [17, 22, 34].”
MethodLogram: Efficient Log Parsing Using n-Gram Dictionaries
Dai, H., Li, H., Chen, C. S., Shang, W., & Chen, T.-H. (2020) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2020.3007554 · Cited by 170
An investigation of the relationships between lines of code and defects
Zhang, H. (2009) · 2009 IEEE International Conference on Software Maintenance · doi:10.1109/icsm.2009.5306304 · Cited by 155 · cited 2×
“In literature, much research work [14, 51, 52] has shown that in a large software system, the distribution of faults is skewed - that a small number of modules accounts for a large proportion of the faults.”
BackgroundSelf-citationSwissLog: Robust and Unified Deep Learning Based Log Anomaly Detection for Diverse Faults
Li, X., Chen, P., Jing, L., He, Z., & Yu, G. (2020) · 2020 IEEE 31st International Symposium on Software Reliability Engineering (ISSRE) · doi:10.1109/issre5003.2020.00018 · Cited by 143 · cited 4×
“SwissLog [27] proposes to use a dictionary-based log parser and an Attentionbased Bi-LSTM network to detect anomalies for diverse faults.”
BackgroundMethodInfluentialAbstracting Execution Logs to Execution Events for Enterprise Applications (Short Paper)
Jiang, Z. M., Hassan, A. E., Flora, P., & Hamann, G. (2008) · 2008 The Eighth International Conference on Quality Software · doi:10.1109/qsic.2008.50 · Cited by 138 · cited 3×
“There are many log parsing techniques, based on frequent pattern mining [10, 38, 45], clustering [16, 42, 44], and heuristics [17, 22, 34].”
MethodComments on "Data Mining Static Code Attributes to Learn Defect Predictors"
Zhang, H., & Zhang, X. (2007) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2007.70706 · Cited by 138 · cited 2×
“Previous studies on software defect prediction models show that prediction results may not always be satisfactory in the presence of imbalanced data distribution [53].”
BackgroundSelf-citationUnsupervised log message anomaly detection
Farzad, A., & Gulliver, T. A. (2020) · ICT Express · doi:10.1016/j.icte.2020.06.003 · Cited by 122 · cited 2×
“AutoEncoder has been employed in [13] to detect log anomalies in an unsupervised manner along with Isolation Forest.”
MethodExamining the stability of logging statements
Kabinna, S., Bezemer, C., Shang, W., Syer, M. D., & Hassan, A. E. (2017) · Empirical Software Engineering · doi:10.1007/s10664-017-9518-0 · Cited by 119 · cited 1×
“As real-world software systems constantly evolve, new log events always appear [24, 54].”
BackgroundPredicting Node failure in cloud service systems
Lin, Q., Hsieh, K., Dang, Y., Zhang, H., Sui, K., Xu, Y., Lou, J.-G., Li, C., Wu, Y., Yao, R., et al. (2018) · Proceedings of the 2018 26th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering · doi:10.1145/3236024.3236060 · Cited by 111 · cited 1×
“For a real-world production system, the number of anomalies is much less than the number of normal events [28, 51, 52].”
BackgroundSelf-citationAnomaly Detection from Log Files Using Data Mining Techniques
Breier, J., & Branišová, J. (2015) · Lecture notes in electrical engineering · doi:10.1007/978-3-662-46578-3_53 · Cited by 85 · cited 2×
“Over the years, many data-driven methods have been proposed to automatically detect system anomalies by analyzing log data [6, 7, 12, 29, 47, 50, 54].”
BackgroundLength Matters: Clustering System Log Messages using Length of Words
Shima, K. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.03213 · Cited by 81 · cited 1×
“There are many log parsing techniques, based on frequent pattern mining [10, 38, 45], clustering [16, 42, 44], and heuristics [17, 22, 34].”
MethodOn the Distribution of Software Faults
Zhang, H. (2008) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2007.70771 · Cited by 73 · cited 2×
“In literature, much research work [14, 51, 52] has shown that in a large software system, the distribution of faults is skewed - that a small number of modules accounts for a large proportion of the faults.”
BackgroundSelf-citationExperience Report: Deep Learning-based System Log Analysis for Anomaly Detection
Chen, Z., Liu, J., Gu, W., Su, Y., & Lyu, M. R.-T. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2107.05908 · Cited by 60 · cited 2×
“Other studies [8, 15, 36] apply fixed/sliding windows to group log events into log sequences, then shuffle all logs sequences before splitting them into training and testing sets.”
BackgroundMethodAnomaly Detection via Mining Numerical Workflow Relations from Logs
Zhang, B., Zhang, H., Moscato, P., & Zhang, A. (2020) · IEEE Symposium on Reliable Distributed Systems (SRDS) · doi:10.1109/srds51746.2020.00027 · Cited by 46 · cited 5×
“In recent years, many deep learning-based models have been proposed to analyze log data and detect anomalies [6, 12, 27, 39, 48, 50, 54].”
BackgroundMethodInfluentialSelf-citationLoghub: A Large Collection of System Log Datasets for AI-driven Log AnalyticsPreprint
Zhu, J., He, S., He, P., et al. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2008.06448 · Cited by 40 · cited 1×
“To evaluate the studied models for log-based anomaly detection, we select four public datasets [2, 20], namely HDFS, BGL, Thunderbird, and Spirit.”
MethodLog2vec A Heterogeneous Graph Embedding Based Approach for Detecting Cyber Threats within Enterprise
Fu-cheng, L., Wen, Y., Dongxue, Z., Jiang, X., Xing, X., & Meng, D. (2019) · ACM Proceedings · Cited by 37
A Survey on Automated Log Analysis for Reliability EngineeringPreprint
He, S., He, P., Chen, Z., et al. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2009.07237 · Cited by 34 · cited 1×
“Log data is usually unstructured text messages, which can help engineers understand the system’s internal status and facilitate monitoring, administering, and troubleshooting of the system [18].”
BackgroundInformation Science and Applications
Kim, K. J., & Kim, H.-Y. (2019) · Lecture notes in electrical engineering · doi:10.1007/978-981-15-1465-4 · Cited by 32
LogBERT: Log Anomaly Detection via BERT
Guo, H., Yuan, S., & Wu, X. (2021) · arXiv · doi:10.48550/arxiv.2103.04475 · Cited by 7 · cited 3×
“It has been applied in [15, 26, 39] for log-based anomaly detection.”
MethodSelf-Attentive Classification-Based Anomaly Detection in Unstructured LogsPreprint
Nedelkoski, S., Bogatinovski, J., Acker, A., et al. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2008.09340 · Cited by 5 · cited 3×
“It has been applied in [15, 26, 39] for log-based anomaly detection.”
BackgroundMethodAnomaly Detection via Mining Numerical Workflow Relations from LogsPreprint
Zhang, B., Zhang, H., Moscato, P., & Zhang, A. (2020) · doi:10.36227/techrxiv.12570926 · Cited by 4
Self-citation
Research works printed but not linked: 2
- [21] Sepp Hochreiter and Jürgen Schmidhuber. 1997. Long short-term memory. Neural computation 9, 8 (1997), 1735-1780. -
- [31] XuLiu, Weiyou Liu, Xiaoqiang Di, Jinqing Li, Binbin Cai, Weiwu Ren, and Huamin Yang. 2021. LogNADS: Network anomaly detection scheme based on semantic representation. Future Generation Computer Systems (2021). -
Cited by
Deep learning for anomaly detection in log data: A survey
Landauer, M., Onder, S., Skopik, F., & Wurzenberger, M. (2023) · Machine Learning with Applications · doi:10.1016/j.mlwa.2023.100470 · Cited by 202
“tions of evaluation results, it is recommended to also compute metrics that are more robust against class imbalance, such as the specificity or true negative rate [10].”
BackgroundMethodInfluentialLog Parsing with Prompt-based Few-shot Learning
Le, V.-H., & Zhang, H. (2023) · 2023 IEEE/ACM 45th International Conference on Software Engineering (ICSE) · doi:10.1109/icse48619.2023.00204 · Cited by 129
“Typical applications of log analysis include anomaly detection [1], [54], [55], [56], failure prediction [7], [8], root cause analysis [5], [6], etc.”
MethodSelf-citationLILAC: Log Parsing using LLMs with Adaptive Parsing Cache
Jiang, Z., Liu, J., Chen, Z., Li, Y., Huang, J., Huo, Y., He, P., Gu, J., & Lyu, M. R. (2024) · Proceedings of the ACM on Software Engineering · doi:10.1145/3643733 · Cited by 123
“LILAC consists of two main components, the ICL-enhanced parser and the adaptive parsing cache .”
LogFiT: Log Anomaly Detection Using Fine-Tuned Language Models
Almodovar, C., Sabrina, F., Karimi, S., & Azad, S. (2024) · IEEE Transactions on Network and Service Management · doi:10.1109/tnsm.2024.3358730 · Cited by 111
“Consequently, Machine Learning (ML) and Deep Learning (DL)-based solutions have been proposed to automatically detect anomalies from system log data, thereby reducing the burden on human operators [4], [5], [6].”
BackgroundLogGPT: Exploring ChatGPT for Log-Based Anomaly Detection
Qi, J., Huang, S., Luan, Z., Yang, S., Fung, C., Yang, H., Qian, D., Shang, J., Xiao, Z., & Wu, Z. (2023) · 2023 IEEE International Conference on High Performance Computing & Communications, Data Science & Systems, Smart City & Dependability in Sensor, Cloud & Big Data Systems & Application (HPCC/DSS/SmartCity/DependSys) · doi:10.1109/hpcc-dss-smartcity-dependsys60770.2023.00045 · Cited by 102
“We believe this is still due to the abnormal diversity, BGL (143 anomaly) has more diversity of abnormal than Spirit (121 anomaly).”
MethodInfluential
Metadata
- Authors
- Le, V.-H., & Zhang, H.
- Affiliations
- University of Newcastle Australia (AU)
- Venue
- Proceedings of the 44th International Conference on Software Engineering
- Publisher
- ACM
- Published
- 2022-05-21
- Pages
- 1356-1367
- ISSN
- 0270-5257 (ISSN-L)
- OpenAlex
- W4226128225
- Cited by
- 257
- References
- 51
- Citations by year
- 2026: 59 · 2025: 88 · 2024: 57 · 2023: 49 · 2022: 4
- FWCI
- 47.97
- Type
- conference paper
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- Funders
- Australian Research Council?s Discovery Projects (DP200102940)
- Topics
- Physical Sciences › Computer Science › Computer Networks and Communications › Software System Performance and Reliability
- Physical Sciences › Computer Science › Artificial Intelligence › Anomaly Detection Techniques and Applications
- Physical Sciences › Computer Science › Software › Software Testing and Debugging Techniques
- Keywords
- log anomaly detection, deep learning models, model evaluation, training data selection, data grouping, class distribution, noisy data, early detection
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.