Practitioners’ Expectations on Log Anomaly Detection
Open accessThe DOI matches its Crossref record; 95 of the 95 references it cites were found in a registry or an index; 12 of the 32 sources its claims cite were checked for support.
Abstract
Log anomaly detection has become a common practice for software engineers to analyze software system behavior. Despite significant research efforts in log anomaly detection over the past decade, it remains unclear what are practitioners’ expectations on log anomaly detection and whether current research meets their needs. To fill this gap, we conduct an empirical study, surveying 312 practitioners from 36 countries about their expectations on log anomaly detection. In particular, we investigate various factors influencing practitioners’ willingness to adopt log anomaly detection tools. We then perform a literature review on log anomaly detection, focusing on publications in premier venues from 2015 to 2025, to compare practitioners’ needs with the current state of research. Based on this comparison, we highlight the directions for researchers to focus on to develop log anomaly detection techniques that better meet practitioners’ expectations.
Overview
CoChat Summary
TL;DR
This empirical study surveys 312 practitioners from 36 countries and interviews 15 professionals to identify expectations for log anomaly detection, then compares those expectations with 36 premier-venue papers from 2014–2024. It finds strong practitioner demand for automated tools but major gaps in interpretability, generalizability, customization, privacy, and use of metrics/traces.
Key findings
- 95.5% of surveyed practitioners consider automated log anomaly detection tools essential or worthwhile, yet only 55.8% currently use log monitoring tools for anomaly detection; one-third of those tools cannot automatically identify anomalies.
- Practitioners prioritize correct detection: over 70% expect recall and precision above 60%, and 70.5% prefer log sequence-level detection, with 29.5% preferring log event-level detection.
- Data availability exceeds research use: 83.7% and 74.9% of practitioners report metrics and traces as always or sometimes available, but only 4 of 36 reviewed papers incorporate metrics or traces.
- The literature review finds only 6 papers explicitly perform log event-level detection, over half do not mention detection time, and few or no papers address interpretability, generalizability, customization, or privacy protection.
Methods
- Mixed-methods design: semi-structured interviews with 15 professionals from eight IT companies (average 8.07 years experience), followed by an online survey of 312 practitioners from 36 countries.
- Survey analysis used percentages for single/multiple-choice questions and Likert-scale charts; open-ended responses were qualitatively analyzed, with “I don’t know” ratings excluded (<1% of valid responses).
- Literature review searched IEEE, ACM, DBLP, and Google Scholar for 2014–2024 premier-venue publications, applied inclusion criteria and forward snowballing, and identified 36 papers; two authors analyzed capabilities across nine factors.
Limitations
- The paper states that some practitioners may not fully comprehend the questions, mitigated by instructions, a flow chart, and excluding “I don’t know” responses.
- The paper states the sample does not encompass all software engineers, is limited to company practitioners and GitHub contributors, and excludes practitioners not proficient in English or Chinese; additional adoption factors may exist.
- Evident from the text: recruitment through social/professional circles and GitHub contributors may introduce selection bias, and the literature review is restricted to premier venues and specific inclusion criteria, so it may not represent all log anomaly detection research.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures










Verification
Claims the paper makes
3 Valid · 9 Not valid · 9 Not checked · 163 Own results and interpretations
The cited sources that could be checked couldn’t confirm or dispute this claim.
In the paper
“BGL logs primarily contain information related to the RAS kernel”
§ Practitioners' Expectations on Log Anomaly Detection > Generalizability.
What the sources say
- Could not verifycites [22] C. Wohlin, "Guidelines for snowballing in systematic literature studies and a replication in software engineering," in Proceedings of the 18th international conference on evaluation and assessment in software engineering, 2014, pp. 1-10. sourceExperimental — accuracy not yet measured
Our copy of Wohlin (2014) is entirely about snowballing as a search approach for systematic literature studies in software engineering, with a replication of MacDonell et al.'s cross-company effort-estimation review (Sections 2-4.10). No passage mentions BGL logs, log analysis, or an RAS kernel; searches for 'BGL logs RAS kernel' and 'log data analysis system reliability' returned only snowballing/reliability passages (2. RELATED WORK, 4.1 Introduction, 4.3.1, 7. ACKNOWLEDGMENTS, General Terms). The claim is therefore not addressed by this source at all, and our copy names no alternative work for it. (LLM, conf=0.78)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Could not verify
Every source the paper cites for this claim was checked and supports it.
In the paper
“industrial datasets are often access-restricted due to security and privacy concerns, as highlighted by Lee et al. [5].”
§ Practitioners' Expectations on Log Anomaly Detection > Generalizability.
What the sources say
- Supportedcites Lee et al. [5] C. Lee, T. Yang, Z. Chen, Y. Su, Y. Yang, and M. R. Lyu, "Heteroge- neous anomaly detection for software systems via semi-supervised cross- modal attention," in 2023 IEEE/ACM 45th International Conference on Software Engineering (ICSE). IEEE, 2023, pp. 1724-1736. source
Section III, Data Collection, explicitly states that most industrial datasets are access-restricted and links the limited availability of public data to security and privacy concerns. This supports the citing sentence's paraphrase. (LLM, conf=0.94)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The cited sources that could be checked couldn’t confirm or dispute this claim.
In the paper
“only 4 papers [19], [20], [22], [36] evaluate their techniques across different domains, training on a source domain and testing on a different target domain.”
§ Practitioners' Expectations on Log Anomaly Detection > Generalizability.
What the sources say
- Could not verifycites [19] matched to “Software Engineering for Internet of Things: The Practitioners' Perspective” (2022) sourceExperimental — accuracy not yet measured
The Data sources section counts 66 papers used to derive an IoT development framework; it does not identify four papers evaluating techniques across domains. The Testing section discusses IoT hardware and software testing, but not training on a source domain and testing on a target domain. Searches for that phrase and for cross-domain evaluation found no supporting passage in our copy. (LLM, conf=0.76)
- Could not verifycites [20] M. Hort, M. Kechagia, F. Sarro, and M. Harman, "A survey of per- formance optimization for mobile applications," IEEE Transactions on Software Engineering, vol. 48, no. 8, pp. 2879-2904, 2021. sourceExperimental — accuracy not yet measured
Section 3.2 describes a survey of mobile-application performance optimization publications, but does not count papers evaluated across source and target domains. Searches for “source domain,” “target domain,” and cross-domain evaluation found no passage in our copy addressing the claimed four-paper count or training-and-testing setup. (LLM, conf=0.75)
- Could not verifycites [22] C. Wohlin, "Guidelines for snowballing in systematic literature studies and a replication in software engineering," in Proceedings of the 18th international conference on evaluation and assessment in software engineering, 2014, pp. 1-10. sourceExperimental — accuracy not yet measured
Sections 4.1 and 4.2 describe a replication of a literature review about cross-company and within-company effort-estimation models. Section 4.10 compares literature-review methods, not techniques trained on one domain and tested on another. Our copy does not establish that this paper is one of four papers conducting the cross-domain evaluation claimed. (LLM, conf=0.76)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Could not verify
The cited sources that could be checked couldn’t confirm or dispute this claim.
In the paper
“While 2 papers [19], [36] achieve satisfactory results on public datasets like HDFS”
§ Practitioners' Expectations on Log Anomaly Detection > Generalizability.
What the sources say
- Could not verifycites [19] matched to “Software Engineering for Internet of Things: The Practitioners' Perspective” (2022) sourceExperimental — accuracy not yet measured
The Step 2 passage mentions Hadoop Distributed File System only as a technology discussed in an IoT development study, not as a public dataset. The Data sources and Developers’ perception sections do not report two papers achieving satisfactory results on HDFS; searches for HDFS datasets and evaluation results found no supporting passage. Page numbers were unavailable in our copy. (LLM, conf=0.76)
- Not checked — no full text of the sourcecites [36] X. Wang, J. Song, X. Zhang, J. Tang, W. Gao, and Q. Lin, "Logonline: A semi-supervised log-based anomaly detector aided with online learning mechanism," in 2023 38th IEEE/ACM International Conference on Automated Software Engineering (ASE). IEEE, 2023, pp. 141-152. source
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Could not verify
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“and anomaly detection time to be under 5 seconds when an anomaly appears.”
§ Practitioners' Expectations on Log Anomaly Detection > Scalability.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
123 more claims
Create a free account to see all 184 claims and to verify the 4 references still open.
- Probably not a substantial claim. 29
- It may state two separate claims as one. 33
- The quote only partly states this claim. 2
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“Determines operational usability[41],[146]”
From Large language models for agentic NetOps and AIOps: Architectures, evaluation, and safety (2027) · cites this paper as [146]
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“Online evaluation becomes necessary once an agent proposes actions, because action quality depends on the behaviour of the system being changed [105], [41], [146].”
From Large language models for agentic NetOps and AIOps: Architectures, evaluation, and safety (2027) · cites this paper as [146]
Experimental — accuracy not yet measured
Citations
Cites
A Unified Approach to Interpreting Model Predictions
Lundberg, S., & Lee, S.-I. (2017) · arXiv · doi:10.48550/arxiv.1705.07874 · Cited by 23,707
“Why Should I Trust You?”: Explaining the Predictions of Any Classifier
Ribeiro, M., Singh, S., & Guestrin, C. (2016) · Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Demonstrations · doi:10.18653/v1/n16-3020 · Cited by 6,682
Wohlin, C. (2014) · Proceedings of the 18th International Conference on Evaluation and Assessment in Software Engineering · doi:10.1145/2601248.2601268 · Cited by 4,234 · cited 1×
“Starting from these 35 articles, we perform one level of forward snowballing [22] and gather 71 additional publications.”
Anchors: High-Precision Model-Agnostic Explanations
Ribeiro, M. T., Singh, S., & Guestrin, C. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11491 · Cited by 2,162 · cited 1×
“Regarding interpretability , integrating post-hoc eXplainable Artificial Intelligence (XAI) methods, such as Local Interpretable Model-agnostic Explanations (LIME) [74], SHapley Additive exPla-nations (SHAP) [75], and Anchors [76], with DL models can enhance the understanding of model behavior.”
DeepLog: Anomaly Detection and Diagnosis from System Logs through Deep Learning
Du, M., Li, F., Zheng, G., & Srikumar, V. (2017) · Proceedings of the 2017 ACM SIGSAC Conference on Computer and Communications Security · doi:10.1145/3133956.3134015 · Cited by 1,835 · cited 2×
“L OGS are a crucial source of information in software systems, capturing system runtime behavior and aiding in software engineering tasks like program comprehension [1], [2], anomaly detection [3], [4], [5], [6], and failure diagnosis [7], [8].”
Qualitative methods in empirical studies of software engineering
Seaman, C. B. (1999) · IEEE Transactions on Software Engineering · doi:10.1109/32.799955 · Cited by 1,493 · cited 1×
“We generate our interview questions from two sources: first principles and standard open-ended interviews [13].”
Detecting large-scale system problems by mining console logs
Xu, W., Huang, L., Fox, A., Patterson, D., & Jordan, M. I. (2009) · Proceedings of the ACM SIGOPS 22nd symposium on Operating systems principles · doi:10.1145/1629575.1629587 · Cited by 1,332 · cited 2×
“Most of the papers evaluate their techniques on two public datasets, Hadoop Distributed File System (HDFS) [27] and Blue Gene/L supercomputer (BGL) [28], typically grouping logs into sequences using sessions and window sizes.”
Robust log-based anomaly detection on unstable log data
Zhang, X., Xu, Y., Lin, Q., Qiao, B., Zhang, H., Dang, Y., Xie, C., Yang, X., Cheng, Q., Li, Z., et al. (2019) · Proceedings of the 2019 27th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering · doi:10.1145/3338906.3338931 · Cited by 761 · cited 1×
“Zhang et al. [50] integrated attention mechanisms with a Bi-LSTM model to capture comprehensive log sequences bidirectionally.”
LogAnomaly: Unsupervised Detection of Sequential and Quantitative Anomalies in Unstructured Logs
Meng, W., Liu, Y., Zhu, Y., Zhang, S., Pei, D., Liu, Y., Chen, Y., Zhang, R., Tao, S., Sun, P., et al. (2019) · Proceedings of the Twenty-Eighth International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2019/658 · Cited by 708 · cited 2×
“L OGS are a crucial source of information in software systems, capturing system runtime behavior and aiding in software engineering tasks like program comprehension [1], [2], anomaly detection [3], [4], [5], [6], and failure diagnosis [7], [8].”
Large language models for software engineering: survey and open problems
Fan, A., Gokkaya, B., Harman, M., Lyubarskiy, M., Sengupta, S., Yoo, S., & Zhang, J. M. (2023) · 2023 IEEE/ACM International Conference on Software Engineering: Future of Software Engineering (ICSE-FoSE) · doi:10.1109/icse-fose59343.2023.00008 · Cited by 650 · cited 1×
“…of LLMs to aid in the development of log anomaly detection techniques, given their increasing popularity for software engineering tasks [68], [69], [70], particularly in log analysis-related activities, such as employing zero-shot learning for log parsing [71] and integrating inter-pretable domain…”
Antoniadi, A. M., Du, Y., Guendouz, Y., Wei, L., Mazo, C., Becker, B. A., & Mooney, C. (2021) · Applied Sciences · doi:10.3390/app11115088 · Cited by 629 · cited 1×
“These techniques aim to provide feature-level explanations by approximating the behavior of the original model with an interpretable model [77], [78], which are also valuable for log anomaly detection.”
Longo, L., Brcic, M., Cabitza, F., Choi, J., Confalonieri, R., Ser, J. D., Guidotti, R., Hayashi, Y., Herrera, F., Holzinger, A., et al. (2024) · Information Fusion · doi:10.1016/j.inffus.2024.102301 · Cited by 626 · cited 1×
“These techniques aim to provide feature-level explanations by approximating the behavior of the original model with an interpretable model [77], [78], which are also valuable for log anomaly detection.”
What Supercomputers Say: A Study of Five System Logs
Oliner, A., & Stearley, J. (2007) · 37th Annual IEEE/IFIP International Conference on Dependable Systems and Networks (DSN'07) · doi:10.1109/dsn.2007.103 · Cited by 620 · cited 2×
“Most of the papers evaluate their techniques on two public datasets, Hadoop Distributed File System (HDFS) [27] and Blue Gene/L supercomputer (BGL) [28], typically grouping logs into sequences using sessions and window sizes.”
Software Testing With Large Language Models: Survey, Landscape, and Vision
Wang, J., Huang, Y., Chen, C., Liu, Z., Wang, S., & Wang, Q. (2024) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2024.3368208 · Cited by 573 · cited 1×
“…potential of LLMs to aid in the development of log anomaly detection techniques, given their increasing popularity for software engineering tasks [68], [69], [70], particularly in log analysis-related activities, such as employing zero-shot learning for log parsing [71] and integrating…”
Large Language Models for Software Engineering: Survey and Open Problems
Fan, A., Gokkaya, B., Harman, M., Lyubarskiy, M., Sengupta, S., Yoo, S., & Zhang, J. M. (2023) · arXiv · doi:10.48550/arxiv.2310.03533 · Cited by 523
Log clustering based problem identification for online service systems
Lin, Q., Zhang, H., Lou, J.-G., Zhang, Y., & Chen, X. (2016) · Proceedings of the 38th International Conference on Software Engineering Companion · doi:10.1145/2889160.2889232 · Cited by 427
Sampling in software engineering research: a critical review and guidelines
Baltes, S., & Ralph, P. (2022) · Empirical Software Engineering · doi:10.1007/s10664-021-10072-8 · Cited by 382 · cited 1×
“For interviews, we employ expert sampling, a subtype of purposive sampling [14], to target professionals with relevant expertise in log analysis to gather valuable insights.”
Log-based Anomaly Detection Without Log Parsing
Le, V.-H., & Zhang, H. (2021) · 2021 36th IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1109/ase51524.2021.9678773 · Cited by 361 · cited 2×
“L OGS are a crucial source of information in software systems, capturing system runtime behavior and aiding in software engineering tasks like program comprehension [1], [2], anomaly detection [3], [4], [5], [6], and failure diagnosis [7], [8].”
A Survey on Automated Log Analysis for Reliability Engineering
He, S., He, P., Chen, Z., Yang, T., Su, Y., & Lyu, M. R. (2022) · ACM Computing Surveys · doi:10.1145/3460345 · Cited by 334 · cited 1×
“He et al. [93] examined the four main steps in the automated log analysis framework: logging, log compression, log parsing, and log mining.”
Loghub: a large collection of system log datasets for AI-driven log analytics
Zhu, J., He, S., He, P., Liu, J., & Lyu, M. R. (2023) · 2023 IEEE 34th International Symposium on Software Reliability Engineering (ISSRE) · doi:10.1109/issre59848.2023.00071 · Cited by 302 · cited 1×
“…conducted an in-depth examination of this concern, arguing that commonly used public datasets (such as HDFS [27] and BGL [28]) or collections of log datasets (e.g., Loghub [81]) for log analytics in research are often simplistic, allowing straightforward techniques to achieve high detection rates.”
Failure Prediction in IBM BlueGene/L Event Logs
Liang, Y., Zhang, Y., Xiong, H., & Sahoo, R. (2007) · Seventh IEEE International Conference on Data Mining (ICDM 2007) · doi:10.1109/icdm.2007.46 · Cited by 292 · cited 1×
“Liang et al. [84] introduced four classifiers for predicting failure log events.”
Zhou, X., Peng, X., Xie, T., Sun, J., Ji, C., Liu, D., Xiang, Q., & He, C. (2019) · Proceedings of the 2019 27th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering · doi:10.1145/3338906.3338961 · Cited by 277 · cited 1×
“L OGS are a crucial source of information in software systems, capturing system runtime behavior and aiding in software engineering tasks like program comprehension [1], [2], anomaly detection [3], [4], [5], [6], and failure diagnosis [7], [8].”
Log-based anomaly detection with deep learning: how far are we?
Le, V.-H., & Zhang, H. (2022) · Proceedings of the 44th International Conference on Software Engineering · doi:10.1145/3510003.3510155 · Cited by 257 · cited 1×
“Extensive machine learning (ML) and deep learning (DL)-based techniques have been proposed in research for automated log anomaly detection [9], [10], [11], with the aim of reducing manual analysis costs.”
Semi-Supervised Log-Based Anomaly Detection via Probabilistic Label Estimation
Yang, L., Chen, J., Wang, Z., Wang, W., Jiang, J., Dong, X., & Zhang, W. (2021) · 2021 IEEE/ACM 43rd International Conference on Software Engineering (ICSE) · doi:10.1109/icse43902.2021.00130 · Cited by 244 · cited 1×
“Yang et al. [46] combined HDBSCAN Authorized licensed use limited to the terms of the applicable license agreement with IEEE.”
Where do developers log? an empirical study on logging practices in industry
Fu, Q., Zhu, J., Hu, W., Lou, J.-G., Ding, R., Lin, Q., Zhang, D., & Xie, T. (2014) · Companion Proceedings of the 36th International Conference on Software Engineering · doi:10.1145/2591062.2591175 · Cited by 230 · cited 1×
“For instance, Fu et al. [91] surveyed 54 experienced developers at Microsoft to investigate logging practices, particularly where developers choose to log.”
Detecting Anomaly in Big Data System Logs Using Convolutional Neural Network
Lu, S., Wei, X., Li, Y., & Wang, L. (2018) · 2018 IEEE 16th Intl Conf on Dependable, Autonomic and Secure Computing, 16th Intl Conf on Pervasive Intelligence and Computing, 4th Intl Conf on Big Data Intelligence and Computing and Cyber Science and Technology Congress(DASC/PiCom/DataCom/CyberSciTech) · doi:10.1109/dasc/picom/datacom/cyberscitec.2018.00037 · Cited by 220 · cited 1×
“Lu et al. [87] learned local semantic information from log data utilizing CNN with three filters.”
Self-citationDeepTraLog: trace-log combined microservice anomaly detection through graph-based deep learning
Zhang, C., Peng, X., Sha, C., Zhang, K., Fu, Z., Wu, X., Lin, Q., & Zhang, D. (2022) · Proceedings of the 44th International Conference on Software Engineering · doi:10.1145/3510003.3510180 · Cited by 207
LAnoBERT: System log anomaly detection based on BERT masked language model
Lee, Y., Kim, J., & Kang, P. (2023) · Applied Soft Computing · doi:10.1016/j.asoc.2023.110689 · Cited by 191 · cited 1×
“Lee et al. [89] learned log information autonomously without parsing based on BERT.”
Self-Attentive Classification-Based Anomaly Detection in Unstructured Logs
Nedelkoski, S., Bogatinovski, J., Acker, A., Cardoso, J., & Kao, O. (2020) · 2020 IEEE International Conference on Data Mining (ICDM) · doi:10.1109/icdm50108.2020.00148 · Cited by 176 · cited 1×
“%) perform log event level anomaly detection, 3 of them [26], [29], [30] only work at the event level.”
Automated IT system failure prediction: A deep learning approach
Zhang, K., Xu, J., Min, M. R., Jiang, G., Pelechrinis, K., & Zhang, H. (2016) · 2016 IEEE International Conference on Big Data (Big Data) · doi:10.1109/bigdata.2016.7840733 · Cited by 171
Evaluating Large Language Models in Class-Level Code Generation
Du, X., Liu, M., Wang, K., Wang, H., Liu, J., Chen, Y., Feng, J., Sha, C., Peng, X., & Lou, Y. (2024) · Proceedings of the IEEE/ACM 46th International Conference on Software Engineering · doi:10.1145/3597503.3639219 · Cited by 162 · cited 1×
“…of LLMs to aid in the development of log anomaly detection techniques, given their increasing popularity for software engineering tasks [68], [69], [70], particularly in log analysis-related activities, such as employing zero-shot learning for log parsing [71] and integrating inter-pretable…”
SwissLog: Robust and Unified Deep Learning Based Log Anomaly Detection for Diverse Faults
Li, X., Chen, P., Jing, L., He, Z., & Yu, G. (2020) · 2020 IEEE 31st International Symposium on Software Reliability Engineering (ISSRE) · doi:10.1109/issre5003.2020.00018 · Cited by 143
LogFormer: A Pre-train and Tuning Pipeline for Log Anomaly Detection
Guo, H., Yang, J., Liu, J., Bai, J., Wang, B., Li, Z., Zheng, T., Zhang, B., Peng, J., & Tian, Q. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i1.27764 · Cited by 135
Unsupervised log message anomaly detection
Farzad, A., & Gulliver, T. A. (2020) · ICT Express · doi:10.1016/j.icte.2020.06.003 · Cited by 122 · cited 1×
“%) use historical labeled abnormal data, and 3 papers [24], [25], [26] (7.9”
InfluentialLogFiT: Log Anomaly Detection Using Fine-Tuned Language Models
Almodovar, C., Sabrina, F., Karimi, S., & Azad, S. (2024) · IEEE Transactions on Network and Service Management · doi:10.1109/tnsm.2024.3358730 · Cited by 111 · cited 1×
“Recent studies (e.g., [32], [59], [60], [63], [64], [65], [66]) demonstrate that LLMs improve anomaly detection through self-supervised pre-training on large-scale datasets and strong learning capabilities.”
Long short-term memory based operation log anomaly detection
Vinayakumar, R., Soman, K. P., & Poornachandran, P. (2017) · 2017 International Conference on Advances in Computing, Communications and Informatics (ICACCI) · doi:10.1109/icacci.2017.8125846 · Cited by 103 · cited 1×
“Similarly, Vinayakumar et al. [86] utilized a stacked-LSTM model to learn temporal patterns with sparse representations.”
LogTransfer: Cross-System Log Anomaly Detection for Software Systems with Transfer Learning
Chen, R., Zhang, S., Li, D., Zhang, Y., Guo, F., Meng, W., Pei, D., Zhang, Y., Chen, X., & Liu, Y. (2020) · 2020 IEEE 31st International Symposium on Software Reliability Engineering (ISSRE) · doi:10.1109/issre5003.2020.00013 · Cited by 101 · cited 3×
“While 2 papers [23], [48] achieve satisfactory results on public datasets like HDFS, these datasets have limited log information, addressing only one or two types of abnormal patterns [45].”
LogFormer: A Pre-train and Tuning Pipeline for Log Anomaly Detection
Guo, H.-C., Yang, J., Liu, J.-H., Bai, J.-Q., Wang, B.-Y., Li, Z.-J., Zheng, T., Zhang, B., Peng, J.-R., & Tian, Q. (2024) · AAAI Conference on Artificial Intelligence · doi:10.48550/arxiv.2401.04749 · Cited by 100
A Survey of Performance Optimization for Mobile Applications
Hort, M., Kechagia, M., Sarro, F., & Harman, M. (2022) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2021.3071193 · Cited by 91 · cited 1×
“…whether the publications satisfy our inclusion criteria, we manually examine each publication following the three steps adopted in previous surveys [20], [21]: 1) Title: if the publication’s title clearly does not match our inclusion criteria, then it is excluded; 2) Abstract: if the publication’s…”
Self-citationLLMeLog: An Approach for Anomaly Detection based on LLM-enriched Log Events
He, M., Jia, T., Duan, C., Cai, H., Li, Y., & Huang, G. (2024) · Proceedings/Proceedings - International Symposium on Software Reliability Engineering · doi:10.1109/issre62328.2024.00023 · Cited by 79
Self-citationAn Approach for Anomaly Diagnosis Based on Hybrid Graph Model with Logs for Distributed Services
Jia, T., Chen, P., Yang, L., Li, Y., Meng, F., & Xu, J. (2017) · 2017 IEEE International Conference on Web Services (ICWS) · doi:10.1109/icws.2017.12 · Cited by 78
Self-citationAn empirical investigation of practical log anomaly detection for online service systems
Zhao, N., Wang, H., Li, Z., Peng, X., Wang, G., Pan, Z., Wu, Y., Feng, Z., Wen, X., Zhang, W., et al. (2021) · Proceedings of the 29th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering · doi:10.1145/3468264.3473933 · Cited by 77 · cited 4×
“Zhao et al. [45] proposed LogAD, which predicts anomalies while generating reports containing: time series of template counts, normal template sequences represented as finite state automatons (to understand task execution workflows), time series of specific variable values, and distributions of log…”
InfluentialLogEncoder: Log-Based Contrastive Representation Learning for Anomaly Detection
Qi, J., Luan, Z., Huang, S., Fung, C., Yang, H., Li, H., Zhu, D., & Qian, D. (2023) · IEEE Transactions on Network and Service Management · doi:10.1109/tnsm.2023.3239522 · Cited by 75 · cited 1×
“Recent studies (e.g., [32], [59], [60], [63], [64], [65], [66]) demonstrate that LLMs improve anomaly detection through self-supervised pre-training on large-scale datasets and strong learning capabilities.”
Heterogeneous Anomaly Detection for Software Systems via Semi-supervised Cross-modal Attention
Lee, C., Yang, T., Chen, Z., Su, Y., Yang, Y., & Lyu, M. R. (2023) · 2023 IEEE/ACM 45th International Conference on Software Engineering (ICSE) · doi:10.1109/icse48619.2023.00148 · Cited by 68 · cited 2×
“Moreover, publicly available data is typically single-sourced, and industrial datasets are often access-restricted due to security and privacy concerns, as highlighted by Lee et al. [5].”
PLELog: Semi-Supervised Log-Based Anomaly Detection via Probabilistic Label Estimation
Yang, L., Chen, J., Wang, Z., Wang, W., Jiang, J., Dong, X., & Zhang, W. (2021) · 2021 IEEE/ACM 43rd International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1109/icse-companion52605.2021.00106 · Cited by 66
Deep Learning or Classical Machine Learning? An Empirical Study on Log-Based Anomaly Detection
Yu, B., Yao, J., Fu, Q., Zhong, Z., Xie, H., Wu, Y., Ma, Y., & He, P. (2024) · Proceedings of the IEEE/ACM 46th International Conference on Software Engineering · doi:10.1145/3597503.3623308 · Cited by 65 · cited 1×
“Extensive machine learning (ML) and deep learning (DL)-based techniques have been proposed in research for automated log anomaly detection [9], [10], [11], with the aim of reducing manual analysis costs.”
MetaLog: Generalizable Cross-System Anomaly Detection from Logs with Meta-Learning
Zhang, C., Jia, T., Shen, G., Zhu, P., & Li, Y. (2024) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1145/3597503.3639205 · Cited by 64 · cited 4×
“For the two papers [31], [32], the relatively low precision, which failed to reach 40%, may be attributed to the utilization of zero-shot and few-shot prompt learning, which often struggles with in-sufficient context.”
InfluentialSelf-citationLandauer, M., Skopik, F., & Wurzenberger, M. (2024) · Proceedings of the ACM on Software Engineering · doi:10.1145/3660768 · Cited by 61 · cited 2×
“Given that the data may have quality issues [73], researchers should focus on selecting high-quality data for building effective log anomaly detection models.”
On the use of evaluation measures for defect prediction studies
Moussa, R., & Sarro, F. (2022) · ACM SIGSOFT International Symposium on Software Testing and Analysis (ISSTA) · doi:10.1145/3533767.3534405 · Cited by 60 · cited 1×
“…the publications satisfy our inclusion criteria, we manually examine each publication following the three steps adopted in previous surveys [20], [21]: 1) Title: if the publication’s title clearly does not match our inclusion criteria, then it is excluded; 2) Abstract: if the publication’s…”
Self-citationExperience Report: Deep Learning-based System Log Analysis for Anomaly Detection
Chen, Z., Liu, J., Gu, W., Su, Y., & Lyu, M. R.-T. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2107.05908 · Cited by 60
LogClass: Anomalous Log Identification and Classification With Partial Labels
Meng, W., Liu, Y., Zhang, S., Zaiter, F., Zhang, Y., Huang, Y., Yu, Z., Zhang, Y., Song, L., Zhang, M., et al. (2021) · IEEE Transactions on Network and Service Management · doi:10.1109/tnsm.2021.3055425 · Cited by 56 · cited 1×
“%) perform log event level anomaly detection, 3 of them [26], [29], [30] only work at the event level.”
Multi-Scale One-Class Recurrent Neural Networks for Discrete Event Sequence Anomaly Detection
Wang, Z., Chen, Z., Ni, J., Liu, H., Chen, H., & Tang, J. (2021) · Proceedings of the 27th ACM SIGKDD Conference on Knowledge Discovery & Data Mining · doi:10.1145/3447548.3467125 · Cited by 56
Jia, T., Wu, Y., Hou, C., & Li, Y. (2021) · 2021 IEEE 32nd International Symposium on Software Reliability Engineering (ISSRE) · doi:10.1109/issre52982.2021.00021 · Cited by 55
Self-citationImproving Log-Based Anomaly Detection by Pre-Training Hierarchical Transformers
Huang, S.-H., Liu, Y., Fung, C. J., Wang, H., Yang, H.-L., & Luan, Z.-Z. (2023) · IEEE transactions on computers · doi:10.1109/tc.2023.3257518 · Cited by 54
Twin Graph-Based Anomaly Detection via Attentive Multi-Modal Learning for Microservice System
Huang, J., Yang, Y., Yu, H., Li, J., & Zheng, X. (2023) · 2023 38th IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1109/ase56229.2023.00138 · Cited by 50
How Practitioners Expect Code Completion?
Wang, C., Hu, J., Gao, C., Jin, Y., Xie, T., Huang, H., Lei, Z., & Deng, Y. (2023) · Proceedings of the 31st ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering · doi:10.1145/3611643.3616280 · Cited by 50
Zhang, C., Wang, X., Zhang, H., Zhang, H., & Han, P. (2021) · IEEE Transactions on Network and Service Management · doi:10.1109/tnsm.2021.3125967 · Cited by 49
MLog: Mogrifier LSTM-Based Log Anomaly Detection Approach Using Semantic Representation
Fu, Y., Liang, K., & Xu, J. (2023) · IEEE Transactions on Services Computing · doi:10.1109/tsc.2023.3289488 · Cited by 49
Chen, A. R., Chen, T.-H., & Wang, S. (2022) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2021.3071473 · Cited by 47 · cited 1×
“L OGS are a crucial source of information in software systems, capturing system runtime behavior and aiding in software engineering tasks like program comprehension [1], [2], anomaly detection [3], [4], [5], [6], and failure diagnosis [7], [8].”
Loader: A Log Anomaly Detector Based on Transformer
Xiao, T. Y., Quan, Z., Wang, Z.-J., Le, Y., Du, Y., Liao, X., Li, K., & Li, K. (2023) · IEEE Transactions on Services Computing · doi:10.1109/tsc.2023.3280575 · Cited by 47
Interpretable Online Log Analysis Using Large Language Models with Prompt Strategies
Liu, Y., Tao, S., Meng, W., Wang, J., Ma, W., Chen, Y., Zhao, Y., Yang, H., & Jiang, Y. (2024) · Proceedings of the 32nd IEEE/ACM International Conference on Program Comprehension · doi:10.1145/3643916.3644408 · Cited by 47
LogLM: From Task-Based to Instruction-Based Automated Log Analysis
Liu, Y., Ji, Y., Tao, S., He, M., Meng, W., Zhang, S., Sun, Y., Xie, Y., Chen, B., & Yang, H. (2025) · IEEE/ACM International Conference on Software Engineering: Software Engineering in Practice (ICSE-SEIP) · doi:10.1109/icse-seip66354.2025.00041 · Cited by 45 · cited 1×
“Recent studies (e.g., [32], [59], [60], [63], [64], [65], [66]) demonstrate that LLMs improve anomaly detection through self-supervised pre-training on large-scale datasets and strong learning capabilities.”
Log-based Anomaly Detection based on EVT Theory with feedbackPreprint
Liu, J., Huang, J., Huo, Y., Jiang, Z., Gu, J., Chen, Z., Feng, C., Yan, M., & Lyu, M. R.-T. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2306.05032 · Cited by 45
Xie, Y., Zhang, H., & Babar, M. A. (2024) · Proceedings of the ACM on software engineering. · doi:10.1145/3660800 · Cited by 40
Adapting Large Language Models to Log Analysis with Interpretable Domain Knowledge
Ji, Y., Liu, Y., Yao, F., He, M., Tao, S., Zhao, X., Su, C., Yang, X., Meng, W., Xie, Y., et al. (2025) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3746252.3761189 · Cited by 39
Improving Log-Based Anomaly Detection with Component-Aware Analysis
Yin, K., Yan, M., Xu, L., Xu, Z., Li, Z., Yang, D., & Zhang, X. (2020) · 2020 IEEE International Conference on Software Maintenance and Evolution (ICSME) · doi:10.1109/icsme46990.2020.00069 · Cited by 37
CAT: Beyond Efficient Transformer for Content-Aware Anomaly Detection in Event Sequences
Zhang, S., Liu, Y., Zhang, X., Cheng, W., Chen, H., & Xiong, H. (2022) · Proceedings of the 28th ACM SIGKDD Conference on Knowledge Discovery and Data Mining · doi:10.1145/3534678.3539155 · Cited by 35
Yang, L., Chen, J., Gao, S., Gong, Z., Zhang, H., Kang, Y., & Li, H. H. (2024) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3644386 · Cited by 34 · cited 2×
“Yang et al. [24] incorporated a lightweight semantic-based log representation in traditional unsupervised principal component analysis for log anomaly detection.”
InfluentialAre They All Good? Studying Practitioners' Expectations on the Readability of Log Messages
Li, Z., Chen, A. R., Hu, X., Xia, X., Chen, T.-H. P., & Shang, W. (2023) · IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1109/ase56229.2023.00136 · Cited by 33 · cited 1×
“Li et al. [94] employed semi-structured interviews and surveys to examine practitioners’ expectations regarding the readability of log messages and to explore the potential for automatically classifying the readability of these messages.”
Software Engineering for Internet of Things: The Practitioners' Perspective
Fahmideh, M., Ahmad, A., Behnaz, A., Grundy, J., & Susilo, W. (2022) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2021.3070692 · Cited by 30 · cited 1×
“Therefore, in accordance with previous research methodologies [19], we utilized purposive sampling and manually screened professional profiles worldwide and purposely selected practitioners who had been involved in the log-related analysis processes of software systems.”
AutoLog: A Log Sequence Synthesis Framework for Anomaly Detection
Huo, Y., Li, Y., Su, Y., He, P., Xie, Z., & Lyu, M. R.-T. (2023) · IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1109/ase56229.2023.00133 · Cited by 30 · cited 1×
“Huo et al. [40] examined logging statements and constructed execution graphs to identify log-related paths.”
Self-citationAnomaly Detection on Interleaved Log Data With Semantic Association Mining on Log-Entity Graph
Chu, G., Wang, J., Qi, Q., Sun, H., Zhuang, Z., He, B., Jing, Y., Zhang, L., & Liao, J. (2025) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2025.3527856 · Cited by 28
SiaLog: detecting anomalies in software execution logs using the siamese network
Hashemi, S., & Mäntylä, M. (2022) · Automated Software Engineering · doi:10.1007/s10515-022-00365-7 · Cited by 27
Log Sequence Anomaly Detection Based on Template and Parameter Parsing via BERT
Chai, X., Zhang, H., Zhang, J., Sun, Y., & Das, S. K. (2024) · IEEE Transactions on Dependable and Secure Computing · doi:10.1109/tdsc.2024.3428538 · Cited by 26 · cited 4×
“Among the surveyed literature, only Zhao et al. [45] and Chai et al. [64] provide domain-knowledge reports, while Liu et al. [32] and Sui et al. [63] offer concise explanations for anomalies.”
InfluentialZhang, B., Zhang, H., Le, V.-H., Moscato, P., & Zhang, A. (2022) · Automated Software Engineering · doi:10.1007/s10515-022-00370-w · Cited by 24
OneLog: towards end-to-end software log anomaly detection
Hashemi, S., & Mäntylä, M. (2024) · Automated Software Engineering · doi:10.1007/s10515-024-00428-x · Cited by 24 · cited 3×
“However, as indicated in Table II, only 5 papers [23], [31], [33], [48], [63] evaluate their techniques across different domains.”
Log Message Anomaly Detection with Oversampling
Farzad, A., & Gulliver, T. A. (2020) · International Journal of Artificial Intelligence & Applications · doi:10.5121/ijaia.2020.11405 · Cited by 24
Parameter-Efficient Log Anomaly Detection based on Pre-training model and LORA
He, S., Lei, Y., Zhang, Y., Xie, K., & Sharma, P. K. (2023) · Proceedings/Proceedings - International Symposium on Software Reliability Engineering · doi:10.1109/issre59848.2023.00038 · Cited by 23 · cited 1×
“Recent studies (e.g., [32], [59], [60], [63], [64], [65], [66]) demonstrate that LLMs improve anomaly detection through self-supervised pre-training on large-scale datasets and strong learning capabilities.”
Ma, X., Zou, H., He, P., Keung, J., Li, Y., Yu, X., & Sarro, F. (2024) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2024.3513413 · Cited by 22
Self-citationAcLog: An Approach to Detecting Anomalies from System Logs with Active Learning
Duan, C., Jia, T., Li, Y., & Huang, G. (2023) · 2023 IEEE International Conference on Web Services (ICWS) · doi:10.1109/icws60048.2023.00062 · Cited by 20
Self-citationBridging the Gap: LLM-Powered Transfer Learning for Log Anomaly Detection in New Software Systems
Sui, Y., Wang, X., Cui, T., Xiao, T., He, C., Zhang, S., Zhang, Y., Yang, X., Sun, Y., & Pei, D. (2025) · IEEE International Conference on Data Engineering (ICDE) · doi:10.1109/icde65448.2025.00331 · Cited by 20
A language model for statements of software code
Yang, Y., Jiang, Y., Gu, M., Sun, J., Gao, J., & Liu, H. (2017) · IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1109/ase.2017.8115678 · Cited by 19 · cited 1×
“This threat to validity is common and considered tolerable in previous studies [82], [83].”
Automatic abnormal log detection by analyzing log history for providing debugging insight
Kim, J., Savchenko, V., Shin, K., Sorokin, K., Jeon, H., Pankratenko, G., Markov, S., & Kim, C.-J. (2020) · Proceedings of the ACM/IEEE 42nd International Conference on Software Engineering: Software Engineering in Practice · doi:10.1145/3377813.3381371 · Cited by 19 · cited 3×
“%) use historical labeled abnormal data, and 3 papers [24], [25], [26] (7.9”
InfluentialXie, X., Jian, S., Huang, C., Yu, F., & Deng, Y. (2023) · Proceedings/Proceedings - International Symposium on Software Reliability Engineering · doi:10.1109/issre59848.2023.00015 · Cited by 18
LogOnline: A Semi-Supervised Log-Based Anomaly Detector Aided with Online Learning Mechanism
Wang, X., Song, J., Zhang, X., Tang, J., Gao, W., & Lin, Q. (2023) · 2023 38th IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1109/ase56229.2023.00043 · Cited by 18
MADDC: Multi-Scale Anomaly Detection, Diagnosis and Correction for Discrete Event Logs
Wang, X., Yang, L., Li, D., Ma, L., He, Y., Xiao, J., Liu, J., & Yang, Y. (2022) · Proceedings of the 38th Annual Computer Security Applications Conference · doi:10.1145/3564625.3567972 · Cited by 16
An interview study about the use of logs in embedded software engineering
Yang, N., Cuijpers, P. P., Hendriks, D., Schiffelers, R. R. H., Lukkien, J. J., & Serebrenik, A. (2023) · Empirical Software Engineering · doi:10.1007/s10664-022-10258-8 · Cited by 14 · cited 1×
“Yang et al. [95] conducted interviews to understand how developers utilize logs within an embedded software engineering context.”
On the Temporal Relations between Logging and Code
Ding, Z., Tang, Y., Li, Y., Li, H., & Shang, W. (2023) · 2023 IEEE/ACM 45th International Conference on Software Engineering (ICSE) · doi:10.1109/icse48619.2023.00079 · Cited by 14
Practitioners' Expectations on Code Completion
Wang, C., Hu, J., Gao, C., Jin, Y., Xie, T., Huang, H., Lei, Z., & Deng, Y. (2023) · arXiv · Cited by 14
LogGenius: An Unsupervised Log Parsing Framework with Zero-shot Prompt Engineering
Yu, X., Nong, S., He, D., Zheng, W., Ma, T., Liu, N., Li, J., & Xie, G. (2024) · IEEE International Conference on Web Services (ICWS) · doi:10.1109/icws62655.2024.00159 · Cited by 13 · cited 1×
“…software engineering tasks [68], [69], [70], particularly in log analysis-related activities, such as employing zero-shot learning for log parsing [71] and integrating inter-pretable domain knowledge through continual pre-training to Authorized licensed use limited to the terms of the applicable…”
Self-citationRong, G., Gu, S., Shen, H., Zhang, H., & Kuang, H. (2023) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1109/icse48619.2023.00080 · Cited by 11 · cited 1×
“Rong et al. [96] carried out an empirical study using mixed methods, including questionnaire surveys, semi-structured interviews, and code analyses, to explore the relationships between developers’ profiles, experiences, and their logging practices.”
DeepUserLog: Deep Anomaly Detection on User Log Using Semantic Analysis and Key-Value Data
Wang, W., Lu, S., Luo, J., & Wu, C. (2023) · Proceedings/Proceedings - International Symposium on Software Reliability Engineering · doi:10.1109/issre59848.2023.00046 · Cited by 7
LogGC: Novel Approach for Graph-based Log Anomaly Detection
Andonov, S., & Madjarov, G. (2023) · IEEE ... International Conference on Data Mining workshops · doi:10.1109/icdmw60847.2023.00156 · Cited by 6
Using evolutionary annotations from change logs to enhance program comprehension
German, D. M., Rigby, P. C., & Storey, M.-A. (2006) · Proceedings of the 2006 international workshop on Mining software repositories · doi:10.1145/1137983.1138020 · Cited by 2 · cited 1×
“L OGS are a crucial source of information in software systems, capturing system runtime behavior and aiding in software engineering tasks like program comprehension [1], [2], anomaly detection [3], [4], [5], [6], and failure diagnosis [7], [8].”
Xie, Y., Zhang, H., & Babar, M. A. (2024) · arXiv · doi:10.48550/arxiv.2404.11294
Research works printed but not linked: 2
- P. Leavy, Research design: Quantitative, qualitative, mixed methods, arts-based, and community-based participatory research approaches. Guilford Publications, 2022.
- D. Spencer, Card sorting: Designing usable categories. Rosenfeld Media, 2009.
Cited by
Large language models for agentic NetOps and AIOps: Architectures, evaluation, and safety
Bilal, M., Crowcroft, J., Wang, R., Xu, X., & Dustdar, S. (2027) · Computer Science Review · doi:10.1016/j.cosrev.2026.101075 · Cited by 10
“Logs remain the most common operational signal, and also one of the least forgiving [62], [63], [127], [128].”
InfluentialLightweight Techniques for Federated Anomaly Detection in Log Data
Pustozerova, A., Gómez, A. G., Landauer, M., Wurzenberger, M., Skopik, F., Weippl, E. R., Mayer, R. L., & Ekelhart, A. (2026) · IEEE Transactions on Reliability · doi:10.1109/tr.2026.3677674 · Cited by 4
“According to [40], anomaly detection systems must work quickly and with minimal labeled data, as such data are often scarce.”
InfluentialLLM4Log: A Systematic Review of Large Language Model-based Log Analysis
Ma, Z., Yang, J., & Chen, T.-H. P. (2026) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3842759 · Cited by 6
Wang, L., Zhou, X., Zhao, X., & He, Y. (2026) · Neurocomputing · doi:10.1016/j.neucom.2026.133840 · Cited by 1
Program Anomalies Detection by Fuzzy Conceptual Learning From Correct Traces in a Bounded Domain
Islam, F., Alban, A. Q., Malluhi, Q. M., & Jaoua, A. (2025) · IEEE Access · doi:10.1109/access.2025.3640722
“Several methods for detecting anomalies build a training dataset from different sources, such as the states of a network, system [7], or software [8].”
Metadata
- Authors
- Ma, X., Li, Y., Keung, J., Yu, X., Zou, H., Yang, Z., Sarro, F., & Barr, E. T.
- Affiliations
- Hong Kong Metropolitan University (HK)
- City University of Hong Kong (HK)
- Zhejiang University (CN)
- Johns Hopkins University (US)
- Shandong University (CN)
- University College London (GB)
- Venue
- IEEE Transactions on Software Engineering
- Published
- 2025-09
- Volume
- 51
- Issue
- 9
- Pages
- 2455-2471
- ISSN
- 0098-5589 (ISSN-L)
- 1939-3520
- 2326-3881
- OpenAlex
- W4413478212
- Cited by
- 21
- References
- 84
- Citations by year
- 2026: 16 · 2025: 5
- FWCI
- 6.57
- Type
- journal article
- Language
- en
- Open access
- green
- arxiv.org
- Licence
- Locations
- IEEE Transactions on Software Engineering (publishedVersion)
- arXiv (Cornell University) (submittedVersion, cc-by-nc-sa)
- UCL Discovery (University College London) (submittedVersion)
- arXiv (Cornell University)
- Funders
- Research Ethics Committee of the Hong Kong Metropolitan University (HE-SF2025/19)
- Topics
- Physical Sciences › Computer Science › Computer Networks and Communications › Software System Performance and Reliability
- Physical Sciences › Computer Science › Information Systems › Software Engineering Techniques and Practices
- Physical Sciences › Computer Science › Information Systems › Software Engineering Research
- Keywords
- log anomaly detection, practitioner expectations, technology adoption, software logging, software monitoring, research-practice gap
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-11-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-11-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (qwen3.8-omni-flash and gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.