The DOI matches its Crossref record; 57 of the 57 references it cites were found in a registry or an index.
Log Parsing with Prompt-based Few-shot Learning
Open accessAbstract
Logs generated by large-scale software systems provide crucial information for engineers to understand the system status and diagnose problems of the systems. Log parsing, which converts raw log messages into structured data, is the first step to enabling automated log analytics. Existing log parsers extract the common part as log templates using statistical features. However, these log parsers often fail to identify the correct templates and parameters because: 1) they often overlook the semantic meaning of log messages, and 2) they require domain-specific knowledge for different log datasets. To address the limitations of existing methods, in this paper, we propose LogPPT to capture the patterns of templates using prompt-based few-shot learning. LogPPT utilises a novel prompt tuning method to recognise keywords and parameters based on a few labelled log data. In addition, an adaptive random sampling algorithm is designed to select a small yet diverse training set. We have conducted extensive experiments on 16 public log datasets. The experimental results show that LogPPT is effective and efficient for log parsing.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“LogPPT[37] reconstructs log parsing into a promptbased few-shot learning task, accurately extracting templates and parameters with minimal annotations.”
From From Correlation to Intervention: A Survey on Log-Based Causal Analysis for Security and AIOps (2026) · cites this paper as [37]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2018) · arXiv · doi:10.48550/arxiv.1810.04805 · Cited by 73,173
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 54,325
RoBERTa: A Robustly Optimized BERT Pretraining Approach
Liu, Y., Ott, M., Goyal, N., Du, J., Joshi, M., Chen, D., Levy, O., Lewis, M., Zettlemoyer, L., & Stoyanov, V. (2019) · arXiv · doi:10.48550/arxiv.1907.11692 · Cited by 16,515
Decoupled Weight Decay Regularization
Loshchilov, I., & Hutter, F. (2017) · arXiv · doi:10.48550/arxiv.1711.05101 · Cited by 12,522
Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer
Raffel, C., Shazeer, N., Roberts, A., Lee, K., Narang, S., Matena, M., Zhou, Y., Li, W., & Liu, P. J. (2019) · arXiv · doi:10.48550/arxiv.1910.10683 · Cited by 10,929
XLNet: Generalized Autoregressive Pretraining for Language Understanding
Yang, Z., Dai, Z., Yang, Y., Carbonell, J., Salakhutdinov, R., & Le, Q. V. (2019) · arXiv · doi:10.48550/arxiv.1906.08237 · Cited by 6,687
Liu, P., Yuan, W., Fu, J., Jiang, Z., Hayashi, H., & Neubig, G. (2023) · ACM Computing Surveys · doi:10.1145/3560815 · Cited by 4,361
Liu, P., Yuan, W., Fu, J., Jiang, Z., Hayashi, H., & Neubig, G. (2021) · arXiv · doi:10.48550/arxiv.2107.13586 · Cited by 4,352 · cited 1×
“Hard prompt templates usually correspond to natural language phrases [41], in which each token in prompt templates is meaningful and understandable.”
BackgroundPrefix-Tuning: Optimizing Continuous Prompts for Generation
Li, X. L., & Liang, P. (2021) · Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers) · doi:10.18653/v1/2021.acl-long.353 · Cited by 2,473
DeepLog: Anomaly Detection and Diagnosis from System Logs through Deep Learning
Du, M., Li, F., Zheng, G., & Srikumar, V. (2017) · Proceedings of the 2017 ACM SIGSAC Conference on Computer and Communications Security · doi:10.1145/3133956.3134015 · Cited by 1,835
Making Pre-trained Language Models Better Few-shot Learners
Gao, T., Fisch, A., & Chen, D. (2021) · Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers) · doi:10.18653/v1/2021.acl-long.295 · Cited by 1,380
Detecting large-scale system problems by mining console logs
Xu, W., Huang, L., Fox, A., Patterson, D., & Jordan, M. I. (2009) · Proceedings of the ACM SIGOPS 22nd symposium on Operating systems principles · doi:10.1145/1629575.1629587 · Cited by 1,332
Drain: an online log parsing approach with fixed depth tree
He, P., Zhu, J., Zheng, Z., & Lyu, M. R. (2017) · 2017 IEEE International Conference on Web Services (ICWS) · doi:10.1109/icws.2017.13 · Cited by 943
Robust log-based anomaly detection on unstable log data
Zhang, X., Xu, Y., Lin, Q., Qiao, B., Zhang, H., Dang, Y., Xie, C., Yang, X., Cheng, Q., Li, Z., et al. (2019) · Proceedings of the 2019 27th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering · doi:10.1145/3338906.3338931 · Cited by 761
Self-citationExperience Report: System Log Analysis for Anomaly Detection
He, S., Zhu, J., He, P., & Lyu, M. R.-T. (2016) · Proceedings/Proceedings - International Symposium on Software Reliability Engineering · doi:10.1109/issre.2016.21 · Cited by 675
Unified Pre-training for Program Understanding and Generation
Ahmad, W., Chakraborty, S., Ray, B., & Chang, K.-W. (2021) · Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies · doi:10.18653/v1/2021.naacl-main.211 · Cited by 642
Tools and benchmarks for automated log parsing
Zhu, J., He, S., Liu, J., He, P., Xie, Q., Zheng, Z., & Lyu, M. R. (2019) · 2019 IEEE/ACM 41st International Conference on Software Engineering: Software Engineering in Practice (ICSE-SEIP) · doi:10.1109/icse-seip.2019.00021 · Cited by 574
Execution Anomaly Detection in Distributed Systems through Unstructured Log Analysis
Fu, Q., Lou, J., Wang, Y., & Jiang, L. (2009) · Proceedings · doi:10.1109/icdm.2009.60 · Cited by 555
PTR: Prompt Tuning with Rules for Text Classification
Han, X., Zhao, W., Ding, N., Liu, Z., & Sun, M. (2022) · AI Open · doi:10.1016/j.aiopen.2022.11.003 · Cited by 548
A data clustering algorithm for mining patterns from event logs
Vaarandi, R. (2004) · IP Operations and Management · doi:10.1109/ipom.2003.1251233 · Cited by 480
PTR: Prompt Tuning with Rules for Text Classification
Han, X., Zhao, W., Ding, N., Liu, Z., & Sun, M. (2021) · arXiv · doi:10.48550/arxiv.2105.11259 · Cited by 478 · cited 3×
“2) Prompt Tuning: Recently, prompt tuning [37], [38], [39], [40] has been proposed to close the gap between pre-training and downstream tasks.”
BackgroundLogBERT: Log Anomaly Detection via BERT
Guo, H., Yuan, S., & Wu, X. (2021) · 2021 International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn52387.2021.9534113 · Cited by 454
Chen, T. Y., Leung, H., & Mak, I. K. (2004) · Lecture notes in computer science · doi:10.1007/978-3-540-30502-6_23 · Cited by 424
Spell: Streaming Parsing of System Event Logs
Du, M., & Li, F. (2016) · 2016 IEEE 16th International Conference on Data Mining (ICDM) · doi:10.1109/icdm.2016.0103 · Cited by 423
Template-Based Named Entity Recognition Using BART
Cui, L., Wu, Y., Jian, L., Yang, S., & Zhang, Y. (2021) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2021.findings-acl.161 · Cited by 398
Log-based Anomaly Detection Without Log Parsing
Le, V.-H., & Zhang, H. (2021) · 2021 36th IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1109/ase51524.2021.9678773 · Cited by 361 · cited 7×
“Recent studies [16], [33] demonstrate that these pretrained models can be applied to understand the semantic meanings of log messages, thus favouring many downstream log analytics tasks.”
BackgroundMethodInfluentialSelf-citationTemplate-Based Named Entity Recognition Using BART
Cui, L., Wu, Y., Liu, J., Yang, S., & Zhang, Y. (2021) · arXiv · doi:10.48550/arxiv.2106.01760 · Cited by 342
Learning How to Ask: Querying LMs with Mixtures of Soft Prompts
Qin, G., & Eisner, J. (2021) · Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies · doi:10.18653/v1/2021.naacl-main.410 · Cited by 342
An Evaluation Study on Log Parsing and Its Use in Log Mining
He, P., Zhu, J., He, S., Li, J., & Lyu, M. R.-T. (2016) · International Conference on Dependable Systems & Networks/Proceedings · doi:10.1109/dsn.2016.66 · Cited by 274
Log-based anomaly detection with deep learning: how far are we?
Le, V.-H., & Zhang, H. (2022) · Proceedings of the 44th International Conference on Software Engineering · doi:10.1145/3510003.3510155 · Cited by 257
Self-citationLogSig: generating system events from raw textual logs
Tang, L., Li, T., & Perng, C.-S. (2011) · Proceedings of the 20th ACM international conference on Information and knowledge management · doi:10.1145/2063576.2063690 · Cited by 244
WARP: Word-level Adversarial ReProgramming
Hambardzumyan, K., Khachatrian, H., & May, J. (2021) · Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers) · doi:10.18653/v1/2021.acl-long.381 · Cited by 243
Logram: Efficient Log Parsing Using n-Gram Dictionaries
Dai, H., Li, H., Chen, C. S., Shang, W., & Chen, T.-H. P. (2020) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2020.3007554 · Cited by 175
Abstracting log lines to log event types for mining software system logs
Nagappan, M., & Vouk, M. A. (2010) · 2010 7th IEEE Working Conference on Mining Software Repositories (MSR 2010) · doi:10.1109/msr.2010.5463281 · Cited by 171
SwissLog: Robust and Unified Deep Learning Based Log Anomaly Detection for Diverse Faults
Li, X., Chen, P., Jing, L., He, Z., & Yu, G. (2020) · Proceedings/Proceedings - International Symposium on Software Reliability Engineering · doi:10.1109/issre5003.2020.00018 · Cited by 166
No more fine-tuning? an experimental evaluation of prompt tuning in code intelligence
Wang, C., Yang, Y., Gao, C., Peng, Y. F., Zhang, H., & Lyu, M. R.-T. (2022) · ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE) · doi:10.1145/3540250.3549113 · Cited by 161
Self-citationAbstracting Execution Logs to Execution Events for Enterprise Applications (Short Paper)
Jiang, Z. M., Hassan, A. E., Flora, P. K., & Hamann, G. (2008) · Asia-Pacific Conference on Quality Software (APAQS) · doi:10.1109/qsic.2008.50 · Cited by 146
Template-free Prompt Tuning for Few-shot NER
Ma, R., Zhou, X., Gui, T., Tan, Y., Li, L., Zhang, Q., & Huang, X. (2022) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/2022.naacl-main.420 · Cited by 144
UniParser: A Unified Log Parser for Heterogeneous Log Data
Liu, Y., Zhang, X., He, S., Zhang, H., Li, L., Kang, Y., Xu, Y. D., Ma, M., Lin, Q., Dang, Y., et al. (2022) · International World Wide Web Conference (WWW) · doi:10.1145/3485447.3511993 · Cited by 134
Self-citationLogzip: Extracting Hidden Structures via Iterative Clustering for Log Compression
Liu, J., Zhu, J., He, S., He, P., Zheng, Z., & Lyu, M. R.-T. (2019) · IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1109/ase.2019.00085 · Cited by 102
Guidelines for assessing the accuracy of log message template identification techniques
Khan, Z. A., Shin, D., Bianculli, D., & Briand, L. (2022) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1145/3510003.3510101 · Cited by 91
Length Matters: Clustering System Log Messages using Length of WordsPreprint
Shima, K. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.03213 · Cited by 89
Log-based Abnormal Task Detection and Root Cause Analysis for Spark
Lu, S., Rao, B., Wei, X., Tak, B., Wang, L., & Wang, L. (2017) · 2017 IEEE International Conference on Web Services (ICWS) · doi:10.1109/icws.2017.135 · Cited by 86
Das, A., Mueller, F., Siegel, C., & Vishnu, A. (2018) · ACM International Symposium on High-Performance Parallel and Distributed Computing (HPDC) · doi:10.1145/3208040.3208051 · Cited by 86
SwissLog: Robust Anomaly Detection and Localization for Interleaved Unstructured Logs
Li, X., Chen, P., Jing, L., He, Z., & Yu, G. (2022) · IEEE Transactions on Dependable and Secure Computing · doi:10.1109/tdsc.2022.3162857 · Cited by 83
Nedelkoski, S., Bogatinovski, J., Acker, A., Cardoso, J., & Kao, O. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-67667-4_8 · Cited by 78
Efficiently Extracting Operational Profiles from Execution Logs Using Suffix Arrays
Nagappan, M., Wu, K. J., & Vouk, M. A. (2009) · Proceedings/Proceedings - International Symposium on Software Reliability Engineering · doi:10.1109/issre.2009.23 · Cited by 65
Zhang, S., Liu, Y., Meng, W., Luo, Z., Bu, J., Yang, S., Liang, P., Pei, D., Xu, J. J., Zhang, Y., et al. (2018) · ACM SIGMETRICS International Conference on Measurement and Modeling of Computer Systems (SIGMETRICS) · doi:10.1145/3219617.3219643 · Cited by 54
Tao, S., Meng, W., Cheng, Y., Zhu, Y., Liu, Y., Du, C., Han, T., Zhao, Y., Wang, X., & Yang, H. (2022) · ACM SIGMETRICS Performance Evaluation Review · doi:10.1145/3543146.3543168 · Cited by 47
Robust and Transferable Anomaly Detection in Log Data using Pre-Trained Language Models
Ott, H., Bogatinovski, J., Acker, A., Nedelkoski, S., & Kao, O. (2021) · IEEE/ACM International Workshop on Cloud Intelligence (CloudIntelligence) · doi:10.1109/cloudintelligence52565.2021.00013 · Cited by 44
Setianto, F., Tsani, E., Sadiq, F., Domalis, G., Tsakalidis, D., & Kostakos, P. (2021) · IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining (ASONAM) · doi:10.1145/3487351.3492723 · Cited by 36
Anomaly Detection via Mining Numerical Workflow Relations from Logs
Zhang, B., Zhang, H., Moscato, P., & Zhang, A. (2020) · IEEE Symposium on Reliable Distributed Systems (SRDS) · doi:10.1109/srds51746.2020.00027 · Cited by 34
Self-citationGurumdimma, N. Y., Jhumka, A., Liakata, M., Chuah, E., & Browne, J. C. (2016) · IEEE Symposium on Reliable Distributed Systems (SRDS) · doi:10.1109/srds.2016.017 · Cited by 34
InstructionNER: A Multi-Task Instruction-Based Generative Framework for Few-shot NERPreprint
Wang, L., Li, R., Yang, Y. T., Yan, Y., Wang, S., Wu, W., & Xu, W. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2203.03903 · Cited by 25
Zhang, B., Zhang, H., Le, V.-H., Moscato, P., & Zhang, A. (2022) · Automated Software Engineering · doi:10.1007/s10515-022-00370-w · Cited by 23
Self-citationOn the Feasibility of Parser-based Log Compression in Large-Scale Cloud Systems.
Wei, J., Zhang, G., Wang, Y., Liu, Z., Zhu, Z., Chen, J., Sun, T., & Zhou, Q. (2021) · Cited by 8
LogBERT: Log Anomaly Detection via BERT
Guo, H., Yuan, S., & Wu, X. (2021) · arXiv · doi:10.48550/arxiv.2103.04475 · Cited by 7
Research works printed but not linked: 8
- 2022, Artifact for “guidelines for assessing the accuracy of log message template identification techniques”
- 10.18653/v1/P16-1162 · DOI · Paper page
- radford, 2019, Language models are unsupervised multitask learners, OpenAIRE blog, 1, 9
- 2021, A large collection of system log datasets for ai-powered log analytics
- 2022, A toolkit for automated log parsing
- radford, 2018, Improving language understanding by generative pre-training
- 2022, BGL Dataset
- 2022, HDFS dataset
Cited by
Sorted by citations
LILAC: Log Parsing using LLMs with Adaptive Parsing Cache
Jiang, Z., Liu, J., Chen, Z., Li, Y., Huang, J., Huo, Y., He, P., Gu, J., & Lyu, M. R.-T. (2024) · Proceedings of the ACM on software engineering. · doi:10.1145/3643733 · Cited by 148
Cybersecurity Revolution via Large Language Models and Explainable AI
Ghazal, T. M., Janjua, J. I., Abushiba, W., Ahmad, M., Ihsan, A., & Al-Dmour, N. A. (2024) · International Conference on Security of Information and Networks (SIN) · doi:10.1109/sin63213.2024.10871324 · Cited by 97
Generative AI in mobile networks: a survey
Karapantelakis, A., Alizadeh, P., Alabbasi, A., Dey, K., & Nikou, A. (2023) · Annals of Telecommunications · doi:10.1007/s12243-023-00980-9 · Cited by 91
The Current Challenges of Software Engineering in the Era of Large Language Models
Gao, C., Hu, X., Gao, S., Xia, X., & Jin, Z. G. (2025) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3712005 · Cited by 91
Log Parsing: How Far Can ChatGPT Go?
Le, V.-H., & Zhang, H. (2023) · IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1109/ase56229.2023.00206 · Cited by 68
Self-citation
Metadata
- Authors
- Le, V.-H., & Zhang, H.
- Affiliations
- University of Newcastle Australia (AU)
- Chongqing University (CN)
- Venue
- 2023 IEEE/ACM 45th International Conference on Software Engineering (ICSE)
- Publisher
- IEEE
- Published
- 2023-05
- Pages
- 2438-2449
- ISSN
- 0270-5257 (ISSN-L)
- OpenAlex
- W4384345672
- Cited by
- 129
- References
- 56
- Citations by year
- 2026: 40 · 2025: 51 · 2024: 30 · 2023: 8
- FWCI
- 38.92
- Type
- conference paper
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) (publishedVersion)
- arXiv (Cornell University) (submittedVersion, cc-by)
- NOVA (University of Newcastle Australia) (submittedVersion)
- arXiv (Cornell University) (cc-by)
- Funders
- Australian Research Council (DP200102940,DP220103044)
- Topics
- Physical Sciences › Computer Science › Computer Networks and Communications › Software System Performance and Reliability
- Physical Sciences › Computer Science › Information Systems › Software Engineering Research
- Physical Sciences › Computer Science › Information Systems › Advanced Database Systems and Queries
- Keywords
- log parsing, log templates, prompt tuning, log analysis, automated log analysis, training data selection
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
