The DOI matches its Crossref record; 48 of the 49 references it cites were found in a registry or an index.
Tools and Benchmarks for Automated Log Parsing
Open accessAbstract
Logs are imperative in the development and maintenance process of many software systems. They record detailed runtime information that allows developers and support engineers to monitor their systems and dissect anomalous behaviors and errors. The increasing scale and complexity of modern software systems, however, make the volume of logs explodes. In many cases, the traditional way of manual log inspection becomes impractical. Many recent studies, as well as industrial tools, resort to powerful text search and machine learning-based analytics solutions. Due to the unstructured nature of logs, a first crucial step is to parse log messages into structured data for subsequent analysis. In recent years, automated log parsing has been widely studied in both academia and industry, producing a series of log parsers by different techniques. To better understand the characteristics of these log parsers, in this paper, we present a comprehensive evaluation study on automated log parsing and further release the tools and benchmarks for easy reuse. More specifically, we evaluate 13 log parsers on a total of 16 log datasets spanning distributed systems, supercomputers, operating systems, mobile systems, server applications, and standalone software. We report the benchmarking results in terms of accuracy, robustness, and efficiency, which are of practical importance when deploying automated log parsing in production. We also share the success stories and lessons learned in an industrial application at Huawei. We believe that our work could serve as the basis and provide valuable guidance to future research and deployment of automated log parsing.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“While computationally lightweight, these methods struggle to adapt to evolving workloads and often suffer from high false-positive rates when applied to complex, real-world clusters.”
From LINEADAPTER: Parameter-Efficient Fine-Tuning for Log Anomaly Detection and Root Cause Analysis (2025) · cites this paper as [5]
Experimental — accuracy not yet measuredThe check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“pretraining contamination can silently inflate benchmark performance, and contamination checks are now part of mainstream LLM evaluation practice [147], [44], [139].”
From Large language models for agentic NetOps and AIOps: Architectures, evaluation, and safety (2027) · cites this paper as [147]
Experimental — accuracy not yet measuredThe check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“LLM graders can help with structure and readability, but they are not a substitute for tool-grounded correctness and safety scoring.”
From Large language models for agentic NetOps and AIOps: Architectures, evaluation, and safety (2027) · cites this paper as [147]
Experimental — accuracy not yet measuredThe check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“This frequencyratio-based heuristic has been widely adopted in prior work on log anomaly detection, particularly in template blacklisting and rule construction [4], [5].”
From LINEADAPTER: Parameter-Efficient Fine-Tuning for Log Anomaly Detection and Root Cause Analysis (2025) · cites this paper as [5]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
DeepLog: Anomaly Detection and Diagnosis from System Logs through Deep Learning
Du, M., Li, F., Zheng, G., & Srikumar, V. (2017) · Proceedings of the 2017 ACM SIGSAC Conference on Computer and Communications Security · doi:10.1145/3133956.3134015 · Cited by 1,835
Detecting large-scale system problems by mining console logs
Xu, W., Huang, L., Fox, A., Patterson, D., & Jordan, M. I. (2009) · Proceedings of the ACM SIGOPS 22nd symposium on Operating systems principles · doi:10.1145/1629575.1629587 · Cited by 1,332
Drain: an online log parsing approach with fixed depth tree
He, P., Zhu, J., Zheng, Z., & Lyu, M. R. (2017) · 2017 IEEE International Conference on Web Services (ICWS) · doi:10.1109/icws.2017.13 · Cited by 943
Self-citationWhat Supercomputers Say: A Study of Five System Logs
Oliner, A. J., & Stearley, J. (2007) · International Conference on Dependable Systems & Networks/Proceedings · doi:10.1109/dsn.2007.103 · Cited by 695
Experience Report: System Log Analysis for Anomaly Detection
He, S., Zhu, J., He, P., & Lyu, M. R.-T. (2016) · Proceedings/Proceedings - International Symposium on Software Reliability Engineering · doi:10.1109/issre.2016.21 · Cited by 675
Self-citationUsing magpie for request extraction and workload modelling
Barham, P., Donnelly, A., Isaacs, R., & Mortier, R. (2004) · Operating Systems Design and Implementation · Cited by 571
Execution Anomaly Detection in Distributed Systems through Unstructured Log Analysis
Fu, Q., Lou, J., Wang, Y., & Jiang, L. (2009) · Proceedings · doi:10.1109/icdm.2009.60 · Cited by 555
Log clustering based problem identification for online service systems
Lin, Q., Zhang, H., Lou, J., Zhang, Y., & Chen, X. (2016) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1145/2889160.2889232 · Cited by 493
A data clustering algorithm for mining patterns from event logs
Vaarandi, R. (2004) · IP Operations and Management · doi:10.1109/ipom.2003.1251233 · Cited by 480
Spell: Streaming Parsing of System Event Logs
Du, M., & Li, F. (2016) · 2016 IEEE 16th International Conference on Data Mining (ICDM) · doi:10.1109/icdm.2016.0103 · Cited by 423
Research works printed but not linked: 12
- 0, New automated log parsing
- 0, Logz io
- 0, Overview of logs-based metrics
- 0, Loghub A collection of system log datasets for intelligent log analysis
- 0, Automated root cause analysis for spark application failures
- 0, Log Management Service in the Cloud-Loggly
- 0, Log parsing - automated easy to use and efficient
- 0, Splunk
- 0, ElK
- 0, Logentries
- 0, A beginner? guide to logstash grok
- 0, Automated parsing log types
Cited by
Sorted by citations
Items 501–575 of 575
Unsupervised Log Parsing Based on Large Language Models and Entropy
Duan, Y., Xu, J., Fan, C., & Liu, Z. (2025) · International Symposium on System Security, Safety, and Reliability (ISSSR) · doi:10.1109/isssr65654.2025.00013
LRTHT: An Efficient Log Clustering Framework Based on Radix Tree and Hash Table
Li, Y., Qin, T., Zou, J., Wang, C., & Lu, Y.-C. (2025) · Lecture notes in computer science · doi:10.1007/978-981-96-8170-9_19
What Happened in This Pipeline? Diffing Build Logs with CiDiff
Hubner, N., Falleri, J., Uricaru, R., Degueule, T., & Durieux, T. (2025) · Proceedings of the ACM on software engineering. · doi:10.1145/3728966
Tang, P., & Guan, Y. (2025) · Future Generation Computer Systems · doi:10.1016/j.future.2025.108022
Unsupervised Log Sequence Anomaly Detection via Deep Embedded Fuzzy Clustering with FGM-VAE and LSTM
Chen, Y., Zhang, X., Wang, P., & Cao, Z. (2024) · International Academic Exchange Conference on Science and Technology Innovation (IAECST) · doi:10.1109/iaecst64597.2024.11118135
Large Language Models for Online Log Parsing in AIOps
Zhang, S., Fan, D., Liu, Y., He, L., & Ding, Z. (2025) · Lecture notes in computer science · doi:10.1007/978-3-032-04624-6_32
Evaluating Prompt Engineering for Event Log Parsing with Large Language Models: A Comparative StudyPreprint
Akhtar, S., Khan, S., & Parkinson, S. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5351870
Visualizing Extracted Patterns from Dictionary-Based Compression Algorithms
Cherepanov, I., Sessler, D., & Kohlhammer, J. (2025) · International Conference on Information Visualisation (IV) · doi:10.1109/iv68685.2025.00017
A Data-Driven Framework for Anomaly Detection in Industrial Systems Using Log Data
Hewing, M., Zhao, Y., Vossel, M., Nieschler, P., & Kleinert, T. (2025) · Annual Conference of the IEEE Industrial Electronics Society (IECON) · doi:10.1109/iecon58223.2025.11221513
Li, Z., Yu, J., Huang, Z., & Huang, Y. (2025) · IEEE Transactions on Services Computing · doi:10.1109/tsc.2025.3631913 · Cited by 1
An Unsupervised Learning Log Anomaly Detection Method Based on Graph Neural Network
Hu, X., Feng, G., Huang, X., Kong, X., & Lv, H. (2025) · Lecture notes in computer science · doi:10.1007/978-3-032-10466-3_26
LogReader: General-Purpose Log Analysis via Open-Source Large Language Models
Qi, J., Luan, Z., Huang, S., Lu, Y. H., Yang, H., & Qian, D. (2025) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn64981.2025.11227375
Unified Parallel Semantic Log Parsing based on Causal Graph Construction for Attack Attribution
Tan, Z., Anagnostopoulos, C., Parambath, S. P., Xiao, K., & Singer, J. (2025) · IEEE International Conference on Distributed Computing Systems Workshops (ICDCSW) · doi:10.1109/icdcsw63273.2025.00020
LogMerge: improved log parsing based on two-step clustering combined with low-level token processing
Le, H.-V., Nguyen, H., Huynh, N. K., & Phan, H. D. (2025) · International Journal of Information Technology · doi:10.1007/s41870-025-02911-4
Log Parsing with LLMs Featuring Self-reflection and Continuous Refining
Chen, X., Chen, J., Shi, J., Wang, P., & Wang, W. (2026) · Lecture notes in computer science · doi:10.1007/978-981-95-4158-4_18
DLogParser: An Efficient Dynamic Log Parser with Multiple Grouping Criteria
Yuan, J., Wang, C., Zhou, H., Zhang, Y., & Wang, Y. (2026) · Applied Sciences · doi:10.3390/app16020811
POSLOG: Creating a Part of Speech Tagger for Log Messages
Dangendorf, K., Hänsel, S.-O., Rosendahl, J., Heine, F., Kleiner, C., & Wartena, C. (2025) · IEEE International Conference on Intelligent Data Acquisition and Advanced Computing Systems: Technology and Applications (IDAACS) · doi:10.1109/idaacs68557.2025.11322035
LPB-Gen: Systematic Large Log-Parsing Benchmarks Generation
Dai, H., Yao, K., Li, F., You, J., Shen, Q., & Shang, W. (2026) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3787494
The Last Dependency Crusade: Solving Python Dependency Conflicts with LLMs
Bartlett, A., Liem, C. C. S., & Panichella, A. (2025) · IEEE/ACM International Conference on Automated Software Engineering Workshops (ASEW) · doi:10.1109/asew67777.2025.00022
Query-Sparsified Transformer with Adapter Tuning for Log-Based Anomaly Detection
Zheng, W., Li, S., & Wang, X. (2025) · International Conference on Machine Learning and Computer Application (ICMLCA) · doi:10.1109/icmlca66850.2025.11336224
LogInstruct: Knowledge-Driven Instruction Synthesis for Enhancing LLM-Based Log Analysis
Ma, L., Li, Y., Yang, W., Zhou, M., Zhao, M., Fei, B., Li, S., Jiang, S., & Xiao, Y. (2026) · IEEE Transactions on Services Computing · doi:10.1109/tsc.2026.3656204
Shahedi, K., Khouzam, M., Li, H., Lamothe, M., & Khomh, F. (2025) · IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1109/ase63991.2025.00286 · Cited by 1
Sun, M., Sun, Y., & Wang, Y. (2025) · International Conference on Advanced Cloud and Big Data · doi:10.1109/cbd69312.2025.00072
HiLPC: Hierarchical Log Parsing and Correction with LLMs
Li, C., Chang, Y., Li, K., & Sun, Y. (2025) · International Conference on Advanced Cloud and Big Data · doi:10.1109/cbd69312.2025.00021
STLAD: Sparse-Attention and Temporal- Decomposition for Scalable Log Anomaly Detection
Xie, Y., Wang, Y., Feng, K., Chen, L., & Wang, J. (2026) · IEEE Access · doi:10.1109/access.2026.3662060
Unsupervised, Accurate, and Efficient Log Parsing Using Smaller Open Source Large Language Models
Ma, Z., Kim, D. J., & Chen, T.-H. P. (2026) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3796239
BERT-LogAnom: Enhancing Log Anomaly Detection with Gated Residual BiLSTM and Dynamic Thresholding
Lu, X. N., An, S., CHEN, J., Shu, Z., Wang, W., Qi, R., & Diao, Y. (2026) · Electronics · doi:10.3390/electronics15040806
Understanding Industrial Log Analysis: A Multi-Dataset Evaluation of Parsing and Anomaly Detection
Sun, Y., Keung, J., Liao, Y., & Yu, H. K. (2025) · Asia-Pacific Software Engineering Conference (APSEC) · doi:10.1109/apsec66846.2025.00054
AI-Powered Intelligent System through context aware log scrutiny for Anomaly detection
Gupta, S., Asirvatharaj, G., & Talluri, R. T. (2026) · doi:10.1109/comsnets67989.2026.11418291
Murugesan, S. B. P., & Ganesan, D. (2026) · International Conference on Image Processing and Capsule Networks (ICIPCN) · doi:10.1109/icipcn67432.2026.11439026
Boundary-Aware Contrastive Learning for Log Anomaly Detection
Ailabouni, F., Román‐Gallego, J., Pérez‐Delgado, M., & Grande-Pérez, L. (2026) · Applied Sciences · doi:10.3390/app16073208
AI Driven SIEM for Real Time Anomaly Detection
Kulkarni, A., Atkari, D. R., Kulkarni, A., Agarwal, A., & Rathi, S. (2025) · IEEE International Conference on Emerging Trends in Computing and Communication (ETCOM) · doi:10.1109/etcom66606.2025.11436530
Apprentissage machine appliqué à l'analyse et à la prédiction des défaillances dans les systèmes HPC
Platini, M. (2020) · theses.fr (ABES) · doi:10.70675/1df58b0dz981az4830z8161ze30d4fd3a57e
Automated Log-Based Anomaly Detection within Cloud Computing Infrastructures
Vervaet, A. (2023) · theses.fr (ABES) · doi:10.70675/ed5ee972zb50cz4f6bz8bcazc53a6f3b58f1
Ma, J., Xiao, Q., Zhang, Y., He, L., & Chen, H. (2026) · IEEE Internet of Things Journal · doi:10.1109/jiot.2026.3685253
GTCL: Graph-Text Contrastive Learning Meets Log Anomaly Detection
Tan, X., Liu, J., Wu, Y., & Xu, M. (2026) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp55912.2026.11464506
Self-citationParSimMerge: A Scalable Log Parser based on Parallelized Similarity-based Merge Optimization
Zhao, Y. (2026) · International Conference on Big Data, Information and Computer Network (BDICN) · doi:10.1145/3801228.3801287
LogRAIL: A Retrieval-Augmented LLM Reverification Layer for Log Anomaly Detection
WONGWANG, C., Park, D., Kim, M., Cho, S., 이성훈, Park, J., & Park, H. (2026) · IEEE Access · doi:10.1109/access.2026.3688834
EM-Merge: Consolidating Fragmented Templates in LLM Log Parsing
Zhu, Q., Wang, J., Yang, Y., & Tong, L. I. (2026) · Lecture notes in computer science · doi:10.1007/978-981-95-7826-9_17
ilLog: Incremental Learning Based Anomaly Detection From Evolving System Logs
Tian, J., Li, M., Wang, Z., Chen, L., Qin, J., & Gan, J. (2026) · IEEE Transactions on Dependable and Secure Computing · doi:10.1109/tdsc.2026.3690744
Plug it and Play on Logs: A configuration-free statistic-based log parser
Qin, Q., Wu, X., Li, H., & Merlo, E. (2026) · Empirical Software Engineering · doi:10.1007/s10664-026-10870-y · Cited by 1
MagGuard: Detecting Mobile Eavesdropping via Built-In Magnetometers With Contrastive Learning
Pan, H., Yang, L., Fu, Y., Chen, Y.-C., Xue, G., & Ren, J. (2026) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2026.3697471
Next-Gen Mobile Forensics Tool: Timeline Reconstruction from Android Digital Evidence
Pathirana, S., Dushmantha, R., Jayarathna, C., Thilakarathna, B., Senarathna, A. N., & Wijesooriya, A. (2026) · International Congress on Human-Computer Interaction, Optimization and Robotic Applications (ICHORA) · doi:10.1109/ichora69329.2026.11536997 · Cited by 2
LogGCL: GCN-Augmented Structural Contrastive Learning for Unsupervised Log Anomaly Detection
Hu, X., Chen, C., Wang, R., Song, X., & Feng, G. (2026) · Lecture notes in electrical engineering · doi:10.1007/978-981-95-8232-7_15
WiLDash: A Web Application for LLM-Based Wi-Fi Log Data Processing and Human Mobility Analysis
Yang, Q., Zhu, L., & Yuan, Y. (2026) · ASCE International Conference on Transportation and Development (ICTD) · doi:10.1061/9780784487013.033
Amanmadov, N., Iskanderov, J., Bellamkonda, N., Jalan, P., & Oyebode, O. (2026) · International Conference on Multimedia Computing, Networking and Applications (MCNA) · doi:10.1109/mcna69896.2026.11574338 · Cited by 1
Controlled Granularity Tuning for Log-Based Anomaly Detection in Converged HPC-Cloud Environments
Ngwenya, D., Ismail, D. K. B., & Wong, P. (2026) · International Conference on Supercomputing · doi:10.1145/3774895.3813788
A Story About Cohesion and Separation: Label-Free Metric for Log Parser Evaluation
Qin, Q., Zhao, J., Li, H., Shang, W., & Merlo, E. (2026) · IEEE International Conference on Software Analysis, Evolution and Reengineering (SANER) · doi:10.1109/saner67736.2026.00079
R-Log: Incentivizing Log Analysis Capability in LLMs via Reasoning-based Reinforcement Learning
Liu, Y., Chen, Z. Q., Xu, S., He, M., Tao, S., Meng, W., Xie, Y., Han, T., Zhao, C., Du, J., et al. (2026) · IEEE/ACM International Conference on Software Engineering: Software Engineering in Practice (ICSE-SEIP) · doi:10.1145/3786583.3786913 · Cited by 1
LogCraft: Pattern-Guided Iterative Clustering for Efficient Unsupervised LLM-Driven Log Parsing
Hao, Y., & Tian, Y. (2026) · Lecture notes in computer science · doi:10.1007/978-981-92-2759-4_13
Unsupervised Extraction of Latent Structures in Software Operations Data
Qin, Q. (2026) · ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE) · doi:10.1145/3803437.3804863
SCOPE:Tree-based Self-Correcting Online Log Parsing via Syntactic-Semantic Collaboration
Fan, D., Zhang, S., He, L., Liu, M., & Huo, Y. (2026) · IEEE International Conference on Program Comprehension (ICPC) · doi:10.1145/3794763.3794808
PhantomRun: Auto Repair of Compilation Errors in Embedded Open Source Software
Fu, H., Ermedahl, A., Eldh, S., Wiklund, K., Haller, P., & Artho, C. V. (2026) · International Conference on Mining Software Repositories (MSR) · doi:10.1145/3793302.3793346
LogSieve: Task-Aware CI Log Reduction for Sustainable LLM-Based Analysis
Barnes, M. E., Ghaleb, T. A., & Hassan, S. (2026) · International Conference on Mining Software Repositories (MSR) · doi:10.1145/3793302.3793380 · Cited by 1
SLOPE: Fine-Grained Log Parser Combining Syntax with LLM-Distilled Semantic
Lai, S., Huang, H., Chen, P., He, Z., Li, M., & Shen, T. (2026) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3838599
LogNexus: Autonomous Log Analytics Engine for Cloud-Native Distributed Systems
Prabu, R., & Veeramakali, T. (2026) · International Conference on Data Science and Business Systems (ICDSBS) · doi:10.1109/icdsbs69077.2026.11634895
LogDelta: Differential Encoding for Log Data
Li, S., Song, S., & Shen, Z. (2026) · IEEE International Conference on Data Engineering (ICDE) · doi:10.1109/icde65706.2026.00034
Efficient Zero-Shot and Label-free Log Anomaly Detection for Resource-Constrained Systems
Wu, Z., Wang, J., Zheng, L., Zhang, Y., Li, S., & Chen, L. (2026) · IEEE International Conference on Data Engineering (ICDE) · doi:10.1109/icde65706.2026.00056
SLGParser: Practical and Efficient Label-Free Log Parsing Using Large Language Models
Hu, Y., Wang, C., Zhao, L., & Yu, A. (2026) · IEEE International Conference on Data Engineering (ICDE) · doi:10.1109/icde65706.2026.00163
A Study on Log Anomaly Detection with Parameter-Aware Semantic Enhancement
Liu, L., Liu, R., Liu, J., & Luo, R. (2026) · International Conference on Electronic Technology and Information Science (ICETIS) · doi:10.1109/icetis70504.2026.11633490
Self-citationVET-Parser: Variable-Evidence-Driven Log Parsing with Selective Large Language Model Arbitration
Li, M., Khysru, K., Jin, D., & Wei, J. (2026) · World Conference on Computer and Information Security (WCCIS) · doi:10.1109/wccis70285.2026.11650850
FlanBC: A Semantic-Structural Sequence Labeling Framework for Log Parsing
Yuan, J., Guan, B., Wen, K., Fang, J., & Zhou, H. (2026) · Information · doi:10.3390/info17090837
Chou, C.-M., & Chen, S.-K. (2026) · Research Square · doi:10.21203/rs.3.rs-10885441/v1
Interpretable Clustering of Anomalous Log Sequences Using a Shap-Based Surrogate Framework
Magyar, R. A., Nagy, M., & Molontay, R. (2026) · IEEE/IFIP Network Operations and Management Symposium (NOMS) · doi:10.1109/noms69089.2026.11668135
Boundary Conditions for Semantic Log Parsing in Systems Observability Pipelines
Ngwenya, D., Wong, P., & Ismail, D. K. B. (2026) · ACM International Systems and Storage Conference (SYSTOR) · doi:10.1145/3793230.3837775
From Machine Learning to LogBERT: A Survey of Web Log Anomaly Detection for APT and Botnet Threats
Altmimi, S., & Alomari, E. S. (2026) · Al-Noor Journal of Engineering Management and Computer Science · doi:10.71229/7tzh0144
Scalable and Adaptive Log-based Anomaly Detection: A Synergistic Approach
Liu, J., Huang, J., Jiang, Z., Huo, Y., Chen, Z., Gu, J., Feng, C. Q., Yan, M., & Lyu, M. R.-T. (2026) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3846182
Self-citationXin, Q. (2026) · JEECS (Journal of Electrical Engineering and Computer Sciences) · doi:10.54732/jeecs.v11i2.3
Release-Aware Prior-Guided Regex Planning for Token-Bounded Log Retrieval in AIOps
Murugesan, S. B. P. (2026) · International Symposium on Networks, Computers and Communications (ISNCC) · doi:10.1109/isncc70543.2026.11693861
SparkADLS: Robust Semi-supervised Anomaly Detection in Log Series
Roqaya, N., & Papenbrock, T. (2026) · Communications in computer and information science · doi:10.1007/978-3-032-39823-9_16
LogNexus: Effective Log Compression via Unified Redundancy Encoding
Liu, Y., Zhang, K., Chen, Z., & Zheng, Z. (2026) · Proceedings of the ACM on software engineering. · doi:10.1145/3832263
Self-citationProtocol-Aware Multi-Step Summarization of 5G Logs
Kuniyil, N., Jung, W., Mamaghani, A., Shakkottai, S., & Bharadia, D. (2026) · ACM Workshop on Wireless of the Students, by the Students, for the Students (S3) · doi:10.1145/3842433.3843763
A Multi-Parser Benchmark over Android Bug-Report Logs
Bessa, J. A., Filho, R. M., & de Freitas, R. (2026) · Anais do Symposium on Knowledge Discovery, Mining and Learning (KDMiLe) · doi:10.5753/kdmile.2026.32039
Large language models for agentic NetOps and AIOps: Architectures, evaluation, and safety
Bilal, M., Crowcroft, J., Wang, R., Xu, X., & Dustdar, S. (2027) · Computer Science Review · doi:10.1016/j.cosrev.2026.101075 · Cited by 10
Metadata
- Authors
- Zhu, J., He, S., Liu, J., He, P., Xie, Q., Zheng, Z., & Lyu, M. R.
- Affiliations
- Huawei Technologies (China) (CN)
- Chinese University of Hong Kong (HK)
- Sun Yat-sen University (CN)
- ETH Zurich (CH)
- Southwest Minzu University (CN)
- Venue
- 2019 IEEE/ACM 41st International Conference on Software Engineering: Software Engineering in Practice (ICSE-SEIP)
- Publisher
- IEEE
- Published
- 2019-05
- Pages
- 121-130
- OpenAlex
- W2963999143
- Cited by
- 574
- References
- 49
- Citations by year
- 2026: 57 · 2025: 86 · 2024: 108 · 2023: 92 · 2022: 62 · 2021: 89 · 2020: 65 · 2019: 15
- FWCI
- 49.91
- Type
- conference paper
- Language
- en
- Open access
- green
- arxiv.org
- Licence
- Locations
- IEEE/ACM International Conference on Software Engineering: Software Engineering in Practice (ICSE-SEIP) (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Funders
- National Natural Science Foundation of China (61332010, 61502401, 61722214)
- Chinese University of Hong Kong (14210717)
- Topics
- Physical Sciences › Computer Science › Computer Networks and Communications › Software System Performance and Reliability
- Physical Sciences › Computer Science › Information Systems › Software Engineering Research
- Physical Sciences › Computer Science › Information Systems › Software Engineering Techniques and Practices
- Keywords
- benchmarking, structured data extraction
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
