The DOI matches its Crossref record; 130 of the 130 references it cites were found in a registry or an index.
A Survey on Automated Log Analysis for Reliability Engineering
Open accessAbstract
Logs are semi-structured text generated by logging statements in software source code. In recent decades, software logs have become imperative in the reliability assurance mechanism of many software systems, because they are often the only data available that record software runtime information. As modern software is evolving into a large scale, the volume of logs has increased rapidly. To enable effective and efficient usage of modern software logs in reliability engineering, a number of studies have been conducted on automated log analysis. This survey presents a detailed overview of automated log analysis research, including how to automate and assist the writing of logging statements, how to compress logs, how to parse logs into structured event templates, and how to employ logs to detect anomalies, predict failures, and facilitate diagnosis. Additionally, we survey work that releases open-source toolkits and datasets. Based on the discussion of the recent advances, we present several promising future directions toward real-world and next-generation automated log analysis.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Their importance has grown as modern software systems scale, but the increasing volume and heterogeneity of logs make their analysis a significant challenge [59,60].”
From Anomaly detection and root-cause identification in microservices: a survey (2026) · cites this paper as [59]
Citations
Cites
A fast and elitist multiobjective genetic algorithm: NSGA-II
Deb, K., Pratap, A., Agarwal, S., & Meyarivan, T. (2002) · IEEE Transactions on Evolutionary Computation · doi:10.1109/4235.996017 · Cited by 50,053
Distributed Representations of Words and Phrases and their Compositionality
Mikolov, T., Sutskever, I., Chen, K., Corrado, G., & Dean, J. (2013) · arXiv · doi:10.48550/arxiv.1310.4546 · Cited by 24,533 · cited 1×
“NY •Log event sequence: A sequence of log events recording system’s activities. Particularly, each element can simply be the log event ID or log embedding vector, e.g., learned by word2vec algorithms [111]. •Log event count vector: A feature vector recording the log events occurrence in a log partition, where each fea…”
BackgroundKiczales, G., Lamping, J., Mendhekar, A., Maeda, C., Lopes, C., Loingtier, J.-M., & Irwin, J. (1997) · Lecture Notes in Computer Science · doi:10.1007/bfb0053381 · Cited by 2,573
DeepLog: Anomaly Detection and Diagnosis from System Logs through Deep Learning
Du, M., Li, F., Zheng, G., & Srikumar, V. (2017) · Proceedings of the 2017 ACM SIGSAC Conference on Computer and Communications Security · doi:10.1145/3133956.3134015 · Cited by 1,835
Detecting large-scale system problems by mining console logs
Xu, W., Huang, L., Fox, A., Patterson, D., & Jordan, M. I. (2009) · Proceedings of the ACM SIGOPS 22nd symposium on Operating systems principles · doi:10.1145/1629575.1629587 · Cited by 1,332 · cited 5×
“en-source implementation of existing log parsers, this survey focuses on the methodological comparison of these parsers. In additional, while parsing rules can be constructed by analyzing source code [144], we focus on parsers that only utilize logs as input. Mode. Mode is the most important log parsing characteristic…”
BackgroundMethodInfluentialThe Daikon system for dynamic detection of likely invariants
Ernst, M. D., Perkins, J. H., Guo, P. J., McCamant, S., Pacheco, C., Tschantz, M. S., & Xiao, C. (2007) · Science of Computer Programming · doi:10.1016/j.scico.2007.01.015 · Cited by 1,080
Dynamically discovering likely program invariants to support program evolution
Ernst, M. D., Cockrell, J., Griswold, W. G., & Notkin, D. (2001) · IEEE Transactions on Software Engineering · doi:10.1109/32.908957 · Cited by 1,050
Drain: an online log parsing approach with fixed depth tree
He, P., Zhu, J., Zheng, Z., & Lyu, M. R. (2017) · 2017 IEEE International Conference on Web Services (ICWS) · doi:10.1109/icws.2017.13 · Cited by 943 · cited 2×
“P [59] All Yes Iterative partitioning MoLFI [108] All Yes Evolutionary algorithms Online SHISO [113] All No Clustering LenMa [131] All No Clustering Spell [41] All No Longest common subsequence Drain [60, 61] All Yes Heuristics Logram [33] All Yes Frequent pattern mining 5.2 Log Parser Characteristics We explore 15 ex…”
MethodInfluentialSelf-citationLSCs: Breathing Life into Message Sequence Charts
Damm, W., & Harel, D. (2001) · Formal Methods in System Design · doi:10.1023/a:1011227529550 · Cited by 818
Robust log-based anomaly detection on unstable log data
Zhang, X., Xu, Y., Lin, Q., Qiao, B., Zhang, H., Dang, Y., Xie, C., Yang, X., Cheng, Q., Li, Z., et al. (2019) · Proceedings of the 2019 27th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering · doi:10.1145/3338906.3338931 · Cited by 761 · cited 3×
“Poorly written static text and inconsistent dynamic content could affect the subsequent diagnosis and maintenance activities [86, 111, 136, 196].”
BackgroundMethod
Research works printed but not linked: 47
- Anunay Amar and Peter C. Rigby . 2019. Mining historical test logs to predict bugs and localize faults in the test logs . In Proceedings of the IEEE/ACM 41st International Conference on Software Engineering (ICSE’19) . 140--151. Anunay Amar and Peter C. Rigby. 2019. Mining historical test logs to predict bugs and localize faults in the test logs. In Proceedings of the IEEE/ACM 41st International Conference on Software Engineering (ICSE’19). 140--151.
- Raju Balakrishnan and Ramendra K. Sahoo . 2006. Lossless compression for large scale cluster logs . In Proceedings 20th IEEE International Parallel & Distributed Processing Symposium (IPDPS’06) . 7. Raju Balakrishnan and Ramendra K. Sahoo. 2006. Lossless compression for large scale cluster logs. In Proceedings 20th IEEE International Parallel & Distributed Processing Symposium (IPDPS’06). 7.
- Ivan Beschastnikh , Yuriy Brun , Sigurd Schneider , Michael Sloan , and Michael D. Ernst . 2011. Leveraging existing instrumentation to automatically infer invariant-constrained models . In Proceedings of the 19th ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE’11) . 267--277. Ivan Beschastnikh, Yuriy Brun, Sigurd Schneider, Michael Sloan, and Michael D. Ernst. 2011. Leveraging existing instrumentation to automatically infer invariant-constrained models. In Proceedings of the 19th ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE’11). 267--277.
- CFDR. 2020. Computer failure data repository. Retrieved from https://www.usenix.org/cfdr. CFDR. 2020. Computer failure data repository. Retrieved from https://www.usenix.org/cfdr.
- Edward Chuah , Shyh-hao Kuo, Paul Hiew , William-Chandra Tjhi , Gary Lee , John Hammond , Marek T. Michalewicz , Terence Hung , and James C. Browne . 2010. Diagnosing the root-causes of failures from cluster log files . In Proceedings of the International Conference on High Performance Computing (HPC’10) . 1--10. Edward Chuah, Shyh-hao Kuo, Paul Hiew, William-Chandra Tjhi, Gary Lee, John Hammond, Marek T. Michalewicz, Terence Hung, and James C. Browne. 2010. Diagnosing the root-causes of failures from cluster log files. In Proceedings of the International Conference on High Performance Computing (HPC’10). 1--10.
- Sebastian Deorowicz and Szymon Grabowski . 2008 . Sub-atomic field processing for improved web log compression . In Proceedings of the IEEE International Conference on “Modern Problems of Radio Engineering, Telecommunications and Computer Science” (TCSET’08) . 551--556. Sebastian Deorowicz and Szymon Grabowski. 2008. Sub-atomic field processing for improved web log compression. In Proceedings of the IEEE International Conference on “Modern Problems of Radio Engineering, Telecommunications and Computer Science” (TCSET’08). 551--556.
- Rui Ding , Hucheng Zhou , Jian-Guang Lou , Hongyu Zhang , Qingwei Lin , Qiang Fu , Dongmei Zhang , and Tao Xie . 2015 . Log2: A cost-aware logging mechanism for performance diagnosis . In Proceedings of the USENIX Annual Technical Conference (ATC). 139--150 . Rui Ding, Hucheng Zhou, Jian-Guang Lou, Hongyu Zhang, Qingwei Lin, Qiang Fu, Dongmei Zhang, and Tao Xie. 2015. Log2: A cost-aware logging mechanism for performance diagnosis. In Proceedings of the USENIX Annual Technical Conference (ATC). 139--150.
- Stephen E. Hansen and E. Todd Atkins . 1993. Automated system monitoring and notification with swatch . In Proceedings of the 7th USENIX Large Installation System Administration Conference (LISA’93) , Vol. 93 . 145--152. Stephen E. Hansen and E. Todd Atkins. 1993. Automated system monitoring and notification with swatch. In Proceedings of the 7th USENIX Large Installation System Administration Conference (LISA’93), Vol. 93. 145--152.
- Pinjia He , Zhuangbin Chen , Shilin He , and Michael R. Lyu . 2018. Characterizing the natural language descriptions in software logging statements . In Proceedings of the 33rd ACM/IEEE International Conference on Automated Software Engineering (ASE’18) . 178--189. Pinjia He, Zhuangbin Chen, Shilin He, and Michael R. Lyu. 2018. Characterizing the natural language descriptions in software logging statements. In Proceedings of the 33rd ACM/IEEE International Conference on Automated Software Engineering (ASE’18). 178--189.
- Pinjia He , Jieming Zhu , Pengcheng Xu , Zibin Zheng , and Michael R . Lyu . 2018 . A directed acyclic graph approach to online log parsing. Retrieved from https://arXiv:1806.04356. Pinjia He, Jieming Zhu, Pengcheng Xu, Zibin Zheng, and Michael R. Lyu. 2018. A directed acyclic graph approach to online log parsing. Retrieved from https://arXiv:1806.04356.
- Shilin He , Jieming Zhu , Pinjia He , and Michael R. Lyu . 2016. Experience report: System log analysis for anomaly detection . In Proceedings of the 27th IEEE International Symposium on Software Reliability Engineering (ISSRE’16) . 207--218. Shilin He, Jieming Zhu, Pinjia He, and Michael R. Lyu. 2016. Experience report: System log analysis for anomaly detection. In Proceedings of the 27th IEEE International Symposium on Software Reliability Engineering (ISSRE’16). 207--218.
- Shilin He , Jieming Zhu , Pinjia He , and Michael R . Lyu . 2020 . Loghub : A Large Collection of System Log Datasets towards Automated Log Analytics. Retrieved from https://arXiv:2008.06448. Shilin He, Jieming Zhu, Pinjia He, and Michael R. Lyu. 2020. Loghub: A Large Collection of System Log Datasets towards Automated Log Analytics. Retrieved from https://arXiv:2008.06448.
- 10.5555/1525908.1525912 · doi:10.5555/1525908.1525912
- Zhen Ming Jiang , Ahmed E. Hassan , Parminder Flora , and Gilbert Hamann . 2008 . Abstracting execution logs to execution events for enterprise applications . In Proceedings of the 8th International Conference on Quality Software (QSIC). Zhen Ming Jiang, Ahmed E. Hassan, Parminder Flora, and Gilbert Hamann. 2008. Abstracting execution logs to execution events for enterprise applications. In Proceedings of the 8th International Conference on Quality Software (QSIC).
- Suhas Kabinna , Cor-Paul Bezemer , Weiyi Shang , and Ahmed E. Hassan . 2016. Logging library migrations: A case study for the apache software foundation projects . In Proceedings of the 13th International Conference on Mining Software Repositories (MSR’16) . 154--164. Suhas Kabinna, Cor-Paul Bezemer, Weiyi Shang, and Ahmed E. Hassan. 2016. Logging library migrations: A case study for the apache software foundation projects. In Proceedings of the 13th International Conference on Mining Software Repositories (MSR’16). 154--164.
- Suhas Kabinna , Cor-Paul Bezemer , Weiyi Shang , Mark D. Syer , and Ahmed E . Hassan . 2018 . Examining the stability of logging statements. Empir. Softw. Eng . (2018), 290--333. Suhas Kabinna, Cor-Paul Bezemer, Weiyi Shang, Mark D. Syer, and Ahmed E. Hassan. 2018. Examining the stability of logging statements. Empir. Softw. Eng. (2018), 290--333.
- Soila P. Kavulya , Kaustubh Joshi , Felicita Di Giandomenico, and Priya Narasimhan . 2012 . Failure diagnosis of complex systems. In Resilience Assessment and Evaluation of Computing Systems. Springer , 239--261. Soila P. Kavulya, Kaustubh Joshi, Felicita Di Giandomenico, and Priya Narasimhan. 2012. Failure diagnosis of complex systems. In Resilience Assessment and Evaluation of Computing Systems. Springer, 239--261.
- Suleman Khan , Abdullah Gani , Ainuddin Wahid Abdul Wahab , Mustapha Aminu Bagiwa, Muhammad Shiraz, Samee U. Khan, Rajkumar Buyya, and Albert Y. Zomaya. 2016 . Cloud log forensics: Foundations, state of the art, and future directions. ACM Comput. Surveys ( 2016), 178--184. Suleman Khan, Abdullah Gani, Ainuddin Wahid Abdul Wahab, Mustapha Aminu Bagiwa, Muhammad Shiraz, Samee U. Khan, Rajkumar Buyya, and Albert Y. Zomaya. 2016. Cloud log forensics: Foundations, state of the art, and future directions. ACM Comput. Surveys (2016), 178--184.
- Jean-Claude Laprie . 1995 . Dependable computing: Concepts, limits, challenges . In Proceedings of the 25th International Symposium on Fault-tolerant Computing (FTCS’95) . 42--54. Jean-Claude Laprie. 1995. Dependable computing: Concepts, limits, challenges. In Proceedings of the 25th International Symposium on Fault-tolerant Computing (FTCS’95). 42--54.
- Heng Li , Tse-Hsun (Peter) Chen , Weiyi Shang , and Ahmed E . Hassan . 2018 . Studying software logging using topic models. Empir. Softw. Eng . (2018), 2655--2694. Heng Li, Tse-Hsun (Peter) Chen, Weiyi Shang, and Ahmed E. Hassan. 2018. Studying software logging using topic models. Empir. Softw. Eng. (2018), 2655--2694.
- Heng Li , Weiyi Shang , and Ahmed E . Hassan . 2017 . Which log level should developers choose for a new logging statement?Empir. Softw. Eng . (2017), 1684--1716. Heng Li, Weiyi Shang, and Ahmed E. Hassan. 2017. Which log level should developers choose for a new logging statement?Empir. Softw. Eng. (2017), 1684--1716.
- Heng Li , Weiyi Shang , Ying Zou , and Ahmed E . Hassan . 2017 . Towards just-in-time suggestions for log changes. Empir. Softw. Eng . (2017), 1831--1865. Heng Li, Weiyi Shang, Ying Zou, and Ahmed E. Hassan. 2017. Towards just-in-time suggestions for log changes. Empir. Softw. Eng. (2017), 1831--1865.
- Chinghway Lim , Navjot Singh , and Shalini Yajnik . 2008 . A log mining approach to failure analysis of enterprise telephony systems . In Proceedings of the 38th IEEE/IFIP International Conference on Dependable Systems and Networks (DSN’08) . Chinghway Lim, Navjot Singh, and Shalini Yajnik. 2008. A log mining approach to failure analysis of enterprise telephony systems. In Proceedings of the 38th IEEE/IFIP International Conference on Dependable Systems and Networks (DSN’08).
- Jinyang Liu , Jieming Zhu , Shilin He , Pinjia He , Zibin Zheng , and Michael R. Lyu . 2019. Logzip: Extracting hidden structures via iterative clustering for log compression . In Proceedings of the 34th IEEE/ACM International Conference on Automated Software Engineering (ASE’19) . 863--873. Jinyang Liu, Jieming Zhu, Shilin He, Pinjia He, Zibin Zheng, and Michael R. Lyu. 2019. Logzip: Extracting hidden structures via iterative clustering for log compression. In Proceedings of the 34th IEEE/ACM International Conference on Automated Software Engineering (ASE’19). 863--873.
- Zhongxin Liu Xin Xia David Lo Zhenchang Xing Ahmed E. Hassan and Shanping Li. 2019. Which variables should I log?IEEE Trans. Softw. Eng. (2019). Zhongxin Liu Xin Xia David Lo Zhenchang Xing Ahmed E. Hassan and Shanping Li. 2019. Which variables should I log?IEEE Trans. Softw. Eng. (2019).
- Joshua Lockerman , Jose M. Faleiro , Juno Kim , Soham Sankaran , Daniel J. Abadi , James Aspnes , Siddhartha Sen , and Mahesh Balakrishnan . 2018 . The fuzzylog: A partially ordered shared log . In Proceedings of the 13th USENIX Symposium on Operating Systems Design and Implementation (OSDI’18) . 357--372. Joshua Lockerman, Jose M. Faleiro, Juno Kim, Soham Sankaran, Daniel J. Abadi, James Aspnes, Siddhartha Sen, and Mahesh Balakrishnan. 2018. The fuzzylog: A partially ordered shared log. In Proceedings of the 13th USENIX Symposium on Operating Systems Design and Implementation (OSDI’18). 357--372.
- Jian-Guang Lou , Qiang Fu , Shengqi Yang , Ye Xu , and Jiang Li . 2010 . Mining invariants from console logs for system problem detection . In Proceedings of the USENIX Annual Technical Conference (ATC’10) . 1--14. Jian-Guang Lou, Qiang Fu, Shengqi Yang, Ye Xu, and Jiang Li. 2010. Mining invariants from console logs for system problem detection. In Proceedings of the USENIX Annual Technical Conference (ATC’10). 1--14.
- Liang Luo , Suman Nath , Lenin Ravindranath Sivalingam , Madan Musuvathi , and Luis Ceze . 2018 . Troubleshooting transiently recurring errors in production systems with blame-proportional logging . In Proceedings of the USENIX Annual Technical Conference (ATC’18) . 321--334. Liang Luo, Suman Nath, Lenin Ravindranath Sivalingam, Madan Musuvathi, and Luis Ceze. 2018. Troubleshooting transiently recurring errors in production systems with blame-proportional logging. In Proceedings of the USENIX Annual Technical Conference (ATC’18). 321--334.
- Michael R. Lyu (ed.). 1996. Handbook of Software Reliability Engineering. IEEE Computer Society Press. Michael R. Lyu (ed.). 1996. Handbook of Software Reliability Engineering. IEEE Computer Society Press.
- Adetokunbo Makanju , A. Nur Zincir-Heywood , and Evangelos E . Milios . 2012 . A lightweight algorithm for message type extraction in system application logs. IEEE Trans. Knowl. Data Eng . (2012). Adetokunbo Makanju, A. Nur Zincir-Heywood, and Evangelos E. Milios. 2012. A lightweight algorithm for message type extraction in system application logs. IEEE Trans. Knowl. Data Eng. (2012).
- Adetokunbo A. O. Makanju , A. Nur Zincir-Heywood , and Evangelos E. Milios . 2009. Clustering event logs using iterative partitioning . In Proceedings of International Conference on Knowledge Discovery and Data Mining (KDD’09) . 1255--1264. Adetokunbo A. O. Makanju, A. Nur Zincir-Heywood, and Evangelos E. Milios. 2009. Clustering event logs using iterative partitioning. In Proceedings of International Conference on Knowledge Discovery and Data Mining (KDD’09). 1255--1264.
- Meiyappan Nagappan and Mladen A. Vouk . 2010. Abstracting log lines to log event types for mining software system logs . In Proceedings of the 7th IEEE Working Conference on Mining Software Repositories (MSR’10) . 114--117. Meiyappan Nagappan and Mladen A. Vouk. 2010. Abstracting log lines to log event types for mining software system logs. In Proceedings of the 7th IEEE Working Conference on Mining Software Repositories (MSR’10). 114--117.
- Karthik Nagaraj , Charles Killian , and Jennifer Neville . 2012 . Structured comparative analysis of systems logs to diagnose performance problems . In Proceedings of the 9th USENIX Symposium on Networked Systems Design and Implementation (NSDI’12) . 353--366. Karthik Nagaraj, Charles Killian, and Jennifer Neville. 2012. Structured comparative analysis of systems logs to diagnose performance problems. In Proceedings of the 9th USENIX Symposium on Networked Systems Design and Implementation (NSDI’12). 353--366.
- Adam J. Oliner , Archana Ganapathi , and Wei Xu. 2012. Advances and challenges in log analysis. ACM Communication ( 2012 ), 55--61. Adam J. Oliner, Archana Ganapathi, and Wei Xu. 2012. Advances and challenges in log analysis. ACM Communication (2012), 55--61.
- James E. Prewett . 2003 . Analyzing cluster log files using logsurfer . In Proceedings of the 4th Annual Conference on Linux Clusters. Citeseer. James E. Prewett. 2003. Analyzing cluster log files using logsurfer. In Proceedings of the 4th Annual Conference on Linux Clusters. Citeseer.
- John P. Rouillard . 2004 . Real-time log file analysis using the simple event correlator (sec) . In Proceedings of the 18th USENIX Large Installation System Administration Conference (LISA’04) , Vol. 4 . 133--150. John P. Rouillard. 2004. Real-time log file analysis using the simple event correlator (sec). In Proceedings of the 18th USENIX Large Installation System Administration Conference (LISA’04), Vol. 4. 133--150.
- Bianca Schroeder and Garth A. Gibson . 2006. A large-scale study of failures in high-performance computing systems . In Proceedings of the International Conference on Dependable Systems and Networks (DSN’06) . 249--258. Bianca Schroeder and Garth A. Gibson. 2006. A large-scale study of failures in high-performance computing systems. In Proceedings of the International Conference on Dependable Systems and Networks (DSN’06). 249--258.
- Weiyi Shang , Meiyappan Nagappan , and Ahmed E . Hassan . 2015 . Studying the relationship between logging characteristics and the code quality of platform software. Empir. Softw. Eng . (2015), 1--27. Weiyi Shang, Meiyappan Nagappan, and Ahmed E. Hassan. 2015. Studying the relationship between logging characteristics and the code quality of platform software. Empir. Softw. Eng. (2015), 1--27.
- Keiichi Shima. 2016. Length matters: Clustering system log messages using length of words. Retrieved from https://arXiv:1611.03213. Keiichi Shima. 2016. Length matters: Clustering system log messages using length of words. Retrieved from https://arXiv:1611.03213.
- Przemysław Skibiński and Jakub Swacha . 2007 . Fast and efficient log file compression . In Proceedings of 11th East-European Conference on Advances in Databases and Information Systems (ADBIS’07) . 56--69. Przemysław Skibiński and Jakub Swacha. 2007. Fast and efficient log file compression. In Proceedings of 11th East-European Conference on Advances in Databases and Information Systems (ADBIS’07). 56--69.
- Wil Van Der Aalst . 2012. Process mining. Commun. ACM ( 2012 ), 76--83. Wil Van Der Aalst. 2012. Process mining. Commun. ACM (2012), 76--83.
- Stephen Yang , Seo Jin Park , and John K. Ousterhout . 2018. NanoLog: A nanosecond scale logging system . In Proceedings of the USENIX Annual Technical Conference (ATC). 335--350 . Stephen Yang, Seo Jin Park, and John K. Ousterhout. 2018. NanoLog: A nanosecond scale logging system. In Proceedings of the USENIX Annual Technical Conference (ATC). 335--350.
- Kundi Yao , Guilherme B. de Pádua , Weiyi Shang , Catalin Sporea , Andrei Toma , and Sarah Sajedi . 2020. Log4Perf: Suggesting and updating logging locations for web-based systems ’ performance monitoring. Empir. Softw. Eng . ( 2020 ), 488--531. Kundi Yao, Guilherme B. de Pádua, Weiyi Shang, Catalin Sporea, Andrei Toma, and Sarah Sajedi. 2020. Log4Perf: Suggesting and updating logging locations for web-based systems’ performance monitoring. Empir. Softw. Eng. (2020), 488--531.
- Kundi Yao , Heng Li , Weiyi Shang , and Ahmed E . Hassan . 2019 . A study of the performance of general compressors on log files. Empir. Softw. Eng . (2019), 3043--3085. Kundi Yao, Heng Li, Weiyi Shang, and Ahmed E. Hassan. 2019. A study of the performance of general compressors on log files. Empir. Softw. Eng. (2019), 3043--3085.
- 10.5555/2337223.2337236 · doi:10.5555/2337223.2337236
- Xu Zhao , Kirk Rodrigues , Yu Luo , Ding Yuan , and Michael Stumm . 2016 . Non-intrusive performance profiling for entire software stacks based on the flow reconstruction principle . In Proceedings of the 12th Symposium on Operating Systems Design and Implementation (OSDI’16) . 603--618. Xu Zhao, Kirk Rodrigues, Yu Luo, Ding Yuan, and Michael Stumm. 2016. Non-intrusive performance profiling for entire software stacks based on the flow reconstruction principle. In Proceedings of the 12th Symposium on Operating Systems Design and Implementation (OSDI’16). 603--618.
- Jieming Zhu , Shilin He , Jinyang Liu , Pinjia He , Qi Xie , Zibin Zheng , and Michael R. Lyu . 2019. Tools and benchmarks for automated log parsing . In Proceedings of the 41st International Conference on Software Engineering: Software Engineering in Practice (ICSE-SEIP’19) . 121--130. Jieming Zhu, Shilin He, Jinyang Liu, Pinjia He, Qi Xie, Zibin Zheng, and Michael R. Lyu. 2019. Tools and benchmarks for automated log parsing. In Proceedings of the 41st International Conference on Software Engineering: Software Engineering in Practice (ICSE-SEIP’19). 121--130.
Cited by
Loghub: a large collection of system log datasets for AI-driven log analytics
Zhu, J., He, S., He, P., Liu, J., & Lyu, M. R. (2023) · 2023 IEEE 34th International Symposium on Software Reliability Engineering (ISSRE) · doi:10.1109/issre59848.2023.00071 · Cited by 302
Self-citationLog-based anomaly detection with deep learning: how far are we?
Le, V.-H., & Zhang, H. (2022) · Proceedings of the 44th International Conference on Software Engineering · doi:10.1145/3510003.3510155 · Cited by 257
Experience Report: Deep Learning-based System Log Analysis for Anomaly DetectionPreprint
Chen, Z., Liu, J., Gu, W., Su, Y., & Lyu, M. R.-T. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2107.05908 · Cited by 229
Self-citationLogGPT: Exploring ChatGPT for Log-Based Anomaly Detection
Qi, J., Huang, S., Luan, Z., Yang, S., Fung, C., Yang, H., Qian, D., Shang, J., Xiao, Z., & Wu, Z. (2023) · IEEE International Conference on High Performance Computing and Communications; IEEE International Conference on Smart City; IEEE International Conference on Data Science and Systems (HPCC/SmartCity/DSS) · doi:10.1109/hpcc-dss-smartcity-dependsys60770.2023.00045 · Cited by 203
LLMParser: An Exploratory Study on Using Large Language Models for Log Parsing
Ma, Z., Chen, A. R., Kim, D. J., Chen, T.-H. P., & Wang, S. (2024) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1145/3597503.3639150 · Cited by 177
A Large-Scale Evaluation for Log Parsing Techniques: How Far Are We?
Jiang, Z., Liu, J., Huang, J., Li, Y., Huo, Y., Gu, J., Chen, Z., Zhu, J., & Lyu, M. R.-T. (2024) · ACM SIGSOFT International Symposium on Software Testing and Analysis (ISSTA) · doi:10.1145/3650212.3652123 · Cited by 172
Self-citationDivLog: Log Parsing with Prompt Enhanced In-Context Learning
Xu, J., Yang, R., Huo, Y., Zhang, C., & He, P. (2024) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1145/3597503.3639155 · Cited by 164
Self-citationEadro: An End-to-End Troubleshooting Framework for Microservices on Multi-source Data
Lee, C., Yang, T., Chen, Z., Su, Y., & Lyu, M. R. (2023) · 2023 IEEE/ACM 45th International Conference on Software Engineering (ICSE) · doi:10.1109/icse48619.2023.00150 · Cited by 149
“…(§ III-A), yet we herein focus on event occurrences because of two reasons: 1) the logging behavior of microservices highly relies on the developers’ expertise, so the quality of log semantics cannot be guaranteed [16]; 2) the complexity of microservices necessitates lightweight techniques.”
Self-citationZhang, T., Qiu, H., Castellano, G., Rifai, M., Chen, C. S., & Pianese, F. (2023) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2022.3222417 · Cited by 130
UniLog: Automatic Logging via LLM and In-Context Learning
Xu, J., Cui, Z., Zhao, Y., Zhang, X., He, S., He, P., Li, L., Kang, Y., Lin, Q., Dang, Y., et al. (2024) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1145/3597503.3623326 · Cited by 129
Self-citationBrain: Log Parsing With Bidirectional Parallel Tree
Yu, S., He, P., Chen, N., & Wu, Y. (2023) · IEEE Transactions on Services Computing · doi:10.1109/tsc.2023.3270566 · Cited by 126
Self-citationLogFiT: Log Anomaly Detection Using Fine-Tuned Language Models
Almodovar, C., Sabrina, F., Karimi, S., & Azad, S. (2024) · IEEE Transactions on Network and Service Management · doi:10.1109/tnsm.2024.3358730 · Cited by 111
Temporal Logical Attention Network for Log-Based Anomaly Detection in Distributed Systems
Liu, Y., Ren, S., Wang, X., & Zhou, M. (2024) · Sensors · doi:10.3390/s24247949 · Cited by 110
SemParser: A Semantic Parser for Log Analytics
Huo, Y., Su, Y., Lee, C. Q. E., & Lyu, M. R.-T. (2023) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1109/icse48619.2023.00082 · Cited by 96
Self-citationExploring the Effectiveness of LLMs in Automated Logging Statement Generation: An Empirical Study
Li, Y., Huo, Y., Jiang, Z., Zhong, R., He, P., Su, Y., Briand, L., & Lyu, M. R.-T. (2024) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2024.3475375 · Cited by 90
Self-citationAn empirical study of log analysis at Microsoft
He, S., Zhang, X., He, P., Xu, Y. D., Li, L., Kang, Y., Ma, M., Wei, Y., Dang, Y., Rajmohan, S., et al. (2022) · ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE) · doi:10.1145/3540250.3558963 · Cited by 86
Self-citationDeep Learning-based Intrusion Detection Systems: A SurveyPreprint
Xu, Z., Wu, Y., Wang, S., Gao, J., Qiu, T., Wang, Z., Wan, H., & Zhao, X. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2504.07839 · Cited by 84
An empirical investigation of practical log anomaly detection for online service systems
Zhao, N., Wang, H., Li, Z., Peng, X., Wang, G., Pan, Z., Wu, Y., Feng, Z., Wen, X., Zhang, W., et al. (2021) · Proceedings of the 29th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering · doi:10.1145/3468264.3473933 · Cited by 77
Heterogeneous Anomaly Detection for Software Systems via Semi-supervised Cross-modal Attention
Lee, C., Yang, T., Chen, Z., Su, Y., Yang, Y., & Lyu, M. R. (2023) · 2023 IEEE/ACM 45th International Conference on Software Engineering (ICSE) · doi:10.1109/icse48619.2023.00148 · Cited by 68
Self-citationLogKG: Log Failure Diagnosis Through Knowledge Graph
Sui, Y., Zhang, Y., Sun, J., Xu, T., Zhang, S., Li, Z., Sun, Y., Guo, F., Shen, J., Zhang, Y., et al. (2023) · IEEE Transactions on Services Computing · doi:10.1109/tsc.2023.3293890 · Cited by 67
Deep Learning or Classical Machine Learning? An Empirical Study on Log-Based Anomaly Detection
Yu, B., Yao, J., Fu, Q., Zhong, Z., Xie, H., Wu, Y., Ma, Y., & He, P. (2024) · Proceedings of the IEEE/ACM 46th International Conference on Software Engineering · doi:10.1145/3597503.3623308 · Cited by 65
Self-citationSPINE: a scalable log parser with feedback guidance
Wang, X., Zhang, X., Li, L., He, S., Zhang, H., Liu, Y., Zheng, L., Kang, Y., Lin, Q., Dang, Y., et al. (2022) · ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE) · doi:10.1145/3540250.3549176 · Cited by 63
Self-citationNo More Labelled Examples? An Unsupervised Log Parser with LLMs
Huang, J., Jiang, Z., Chen, Z., & Lyu, M. R.-T. (2025) · Proceedings of the ACM on software engineering. · doi:10.1145/3729377 · Cited by 62
Self-citationDemonstration-Free: Towards More Practical Log Parsing with Large Language Models
Xiao, Y., Le, V.-H., & Zhang, H. (2024) · IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1145/3691620.3694994 · Cited by 61
KnowLog: Knowledge Enhanced Pre-trained Language Model for Log Understanding
Ma, L., Yang, W., Xu, B., Jiang, S., Fei, B., Liang, J., Zhou, M., & Xiao, Y. (2024) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1145/3597503.3623304 · Cited by 59
Face It Yourselves: An LLM-Based Two-Stage Strategy to Localize Configuration Errors via Logs
Shan, S., Huo, Y., Su, Y., Li, Y., Li, D., & Zheng, Z. (2024) · ACM SIGSOFT International Symposium on Software Testing and Analysis (ISSTA) · doi:10.1145/3650212.3652106 · Cited by 59
Self-citationInterpretable Failure Localization for Microservice Systems Based on Graph Autoencoder
Sun, Y., Lin, Z., Shi, B., Zhang, S., Ma, S., Jin, P., Zhong, Z., Pan, L., Guo, Y., & Pei, D. (2024) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3695999 · Cited by 59
Failure Diagnosis in Microservice Systems: A Comprehensive Survey and Analysis
Zhang, S., Xia, S., Fan, W., Shi, B., Xiong, X., Zhong, Z., Ma, M., Sun, Y., & Pei, D. (2026) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3715005 · Cited by 57
Semisupervised anomaly detection of multivariate time series based on a variational autoencoder
Chen, N., Tu, H., Duan, X., Hu, L., & Guo, C. (2022) · Applied Intelligence · doi:10.1007/s10489-022-03829-1 · Cited by 57
Bhanage, D. A., Pawar, A., & Kotecha, K. V. (2021) · IEEE Access · doi:10.1109/access.2021.3128283 · Cited by 55
Anomaly Detection in Log Files Using Selected Natural Language Processing Methods
Ryciak, P., Wasielewska, K., & Janicki, A. (2022) · Applied Sciences · doi:10.3390/app12105089 · Cited by 54
On the effectiveness of log representation for log-based anomaly detection
Wu, X., Li, H., & Khomh, F. (2023) · Empirical Software Engineering · doi:10.1007/s10664-023-10364-1 · Cited by 53
AIOps Solutions for Incident Management: Technical Guidelines and A Comprehensive Literature ReviewPreprint
Remil, Y., Bendimerad, A., Mathonat, R., & Kaytoue, M. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2404.01363 · Cited by 53
Identifying Root-Cause Metrics for Incident Diagnosis in Online Service Systems
Wu, C., Zhao, N., Wang, L., Yang, X., Li, S., Zhang, M., Jin, X., Wen, X., Nie, X., Zhang, W., et al. (2021) · Proceedings/Proceedings - International Symposium on Software Reliability Engineering · doi:10.1109/issre52982.2021.00022 · Cited by 50
Impact of log parsing on deep learning-based anomaly detection
Khan, Z. A., Shin, D., Bianculli, D., & Briand, L. C. (2024) · Empirical Software Engineering · doi:10.1007/s10664-024-10533-w · Cited by 49
Go Static: Contextualized Logging Statement Generation
Li, Y., Huo, Y., Zhong, R., Jiang, Z., Liu, J., Huang, J., Gu, J., He, P., & Lyu, M. R.-T. (2024) · Proceedings of the ACM on software engineering. · doi:10.1145/3643754 · Cited by 49
Self-citationLLM-based event log analysis techniques: A surveyPreprint
Akhtar, S., Khan, S., & Parkinson, S. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2502.00677 · Cited by 49
Loader: A Log Anomaly Detector Based on Transformer
Xiao, T. Y., Quan, Z., Wang, Z.-J., Le, Y., Du, Y., Liao, X., Li, K., & Li, K. (2023) · IEEE Transactions on Services Computing · doi:10.1109/tsc.2023.3280575 · Cited by 47
LogGT: Cross-system log anomaly detection via heterogeneous graph feature and transfer learning
Wang, P., Zhang, X., Cao, Z., Xu, W., & Li, W. (2024) · Expert Systems with Applications · doi:10.1016/j.eswa.2024.124082 · Cited by 47
PreLog: A Pre-trained Model for Log Analytics
Le, V.-H., & Zhang, H. (2024) · Proceedings of the ACM on Management of Data · doi:10.1145/3654966 · Cited by 46
LogEval: A comprehensive benchmark suite for LLMs in log analysis
Cui, T., Ma, S., Chen, Z., Xiao, T., Zhao, C., Tao, S., Liu, Y., Zhang, S., Lin, D., Liu, C., et al. (2025) · Empirical Software Engineering · doi:10.1007/s10664-025-10701-6 · Cited by 45
Self-citationExploring Better Black-Box Test Case Prioritization via Log Analysis
Chen, Z., Chen, J., Wang, W., Zhou, J., Wang, M., Chen, X., Zhou, S., & Wang, J. (2022) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3569932 · Cited by 43
Self-citationNORIA-O: An Ontology for Anomaly Detection and Incident Management in ICT Systems
Tailhardat, L., Chabot, Y., & Troncy, R. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-60635-9_2 · Cited by 41
Gholamian, S., & Ward, P. A. S. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2110.12489 · Cited by 41
L4: Diagnosing Large-scale LLM Training Failures via Automated Log Analysis
Jiang, Z., Huang, J., Yu, G., Chen, Z., Li, Y., Zhong, R., Feng, C. Q., Yang, Y., Yang, Z., & Lyu, M. R.-T. (2025) · ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE) · doi:10.1145/3696630.3728531 · Cited by 40
Self-citationLemur: Log Parsing with Entropy Sampling and Chain-of-Thought MergingPreprint
Zhang, W., Guan, X., Yunhong, L., Zhang, J., Song, S., Cheng, X., Wu, Z., & Li, Z. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2402.18205 · Cited by 39
Sahar, S., Younas, M., Khan, M. M., & Sarwar, M. U. (2024) · IEEE Access · doi:10.1109/access.2024.3362896 · Cited by 38
Zhang, B., Gao, Y., Kuang, B., Yu, C., Fu, A., & Susilo, W. (2024) · ACM Computing Surveys · doi:10.1145/3700749 · Cited by 38
LLM Meets ML: Data-efficient Anomaly Detection on Unstable Logs
Hadadi, F., Xu, Q., Bianculli, D., & Briand, L. (2025) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3771283 · Cited by 37
Mapping the Landscape of Generative AI in Network Monitoring and Management
Bovenzi, G., Cerasuolo, F., Ciuonzo, D., Monda, D. D., Guarino, I., Montieri, A., Persico, V., & Pescapè, A. (2025) · IEEE Transactions on Network and Service Management · doi:10.1109/tnsm.2025.3543022 · Cited by 36
Learning Representations on Logs for AIOps
Gupta, P., Kumar, H., Kar, D., Bhukar, K., Aggarwal, P., & Mohapatra, P. (2023) · IEEE ... International Conference on Cloud Computing · doi:10.1109/cloud60044.2023.00026 · Cited by 35
Yang, L., Chen, J., Gao, S., Gong, Z., Zhang, H., Kang, Y., & Li, H. H. (2024) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3644386 · Cited by 34
LEMAD: LLM-Empowered Multi-Agent System for Anomaly Detection in Power Grid Services
Ji, X., Zhang, L., Zhang, W., Peng, F., Mao, Y., Liao, X., & Zhang, K. (2025) · Electronics · doi:10.3390/electronics14153008 · Cited by 33
Automatic Parsing and Utilization of System Log Features in Log Analysis: A Survey
Ma, J., Liu, Y., Wan, H., & Sun, G. (2023) · Applied Sciences · doi:10.3390/app13084930 · Cited by 33
Are They All Good? Studying Practitioners' Expectations on the Readability of Log Messages
Li, Z., Chen, A. R., Hu, X., Xia, X., Chen, T.-H. P., & Shang, W. (2023) · IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1109/ase56229.2023.00136 · Cited by 33
SXAD: Shapely eXplainable AI-Based Anomaly Detection Using Log Data
Alam, K., Kifayat, K., Sampedro, G. A., Karovič, V., & Naeem, T. (2024) · IEEE Access · doi:10.1109/access.2024.3425472 · Cited by 32
LogEDL: Log Anomaly Detection via Evidential Deep Learning
Duan, Y., Xue, K., Sun, H., Bao, H., Wei, Y., You, Z., Zhang, Y., Jiang, X., Yang, S., Chen, J., et al. (2024) · Applied Sciences · doi:10.3390/app14167055 · Cited by 32
LogSummary: Unstructured Log Summarization for Software Systems
Meng, W., Zaiter, F., Zhang, Y., Liu, Y., Zhang, S., Tao, S., Zhu, Y., Han, T., Zhao, Y., Wang, E., et al. (2023) · IEEE Transactions on Network and Service Management · doi:10.1109/tnsm.2023.3236994 · Cited by 32
Batoun, M. A., Sayagh, M., Aghili, R., Ouni, A., & Li, H. (2024) · Empirical Software Engineering · doi:10.1007/s10664-024-10452-w · Cited by 31
End-to-End AutoML for Unsupervised Log Anomaly Detection
Zhang, S., Ji, Y., Luan, J., Nie, X., Chen, Z., Ma, M., Sun, Y., & Pei, D. (2024) · IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1145/3691620.3695535 · Cited by 31
Self-citationNo More Data Silos: Unified Microservice Failure Diagnosis With Temporal Knowledge Graph
Zhang, S., Zhao, Y., Xia, S., Wei, S., Sun, Y., Zhao, C., Ma, S., Kuang, J., Zhu, B., Pan, L., et al. (2024) · IEEE Transactions on Services Computing · doi:10.1109/tsc.2024.3489444 · Cited by 29
Ma, L., Yang, W., Li, Y., Fei, B., Zhou, M., Li, S., Jiang, S., Xu, B., & Xiao, Y. (2025) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3749840 · Cited by 29
LogM : Log Analysis for Multiple Components of Hadoop Platform
Xie, Y., Yang, K., & Luo, P. (2021) · IEEE Access · doi:10.1109/access.2021.3076897 · Cited by 29
Demystifying and Extracting Fault-indicating Information from Logs for Failure Diagnosis
Huang, J., Jiang, Z., Liu, J., Huo, Y., Gu, J., Chen, Z., Feng, C., Dong, H., Yang, Z., & Lyu, M. R.-T. (2024) · Proceedings/Proceedings - International Symposium on Software Reliability Engineering · doi:10.1109/issre62328.2024.00055 · Cited by 29
Self-citationWang, P., Zhang, X., Chen, Y., & Cao, Z. (2024) · Information Processing & Management · doi:10.1016/j.ipm.2024.104013 · Cited by 28
AllInfoLog: Robust Diverse Anomalies Detection Based on All Log Features
Xiao, R., Chen, H., Lu, J., Li, W., & Jin, S. (2022) · IEEE Transactions on Network and Service Management · doi:10.1109/tnsm.2022.3224974 · Cited by 28
Anomaly Detection in Cyber Security with Graph-Based LSTM in Log Analysis
Alaca, Y., Çelik, Y., & Goel, S. (2023) · Chaos Theory and Applications · doi:10.51537/chaos.1348302 · Cited by 28
Distributed system anomaly detection using deep learning‐based log analysis
Han, P., Li, H., Xue, G., & Zhang, C. (2023) · Computational Intelligence · doi:10.1111/coin.12573 · Cited by 27
A Semisupervised Approach for Industrial Anomaly Detection via Self-Adaptive Clustering
Ma, X., Keung, J., He, P., Xiao, Y., Yu, X., & Li, Y. (2023) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2023.3280246 · Cited by 27
Self-citationSystematic Evaluation of Deep Learning Models for Log-based Failure Prediction
Hadadi, F., Dawes, J. H., Shin, D., Bianculli, D., & Briand, L. (2024) · Empirical Software Engineering · doi:10.1007/s10664-024-10501-4 · Cited by 27
HeMiRCA: fine-grained root cause analysis for microservices with heterogeneous data sources
Zhu, Z., Lee, C., Tang, X., & He, P. (2024) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3674726 · Cited by 26
“Logs are semi-structured text generated by logging statements in software source code [21].”
MethodSelf-citationWei, X., Wang, J., Sun, C., Towey, D., Shoufeng, Z., Zuo, W., Yu, Y., Ruan, R., & Song, G. (2024) · Journal of Software Evolution and Process · doi:10.1002/smr.2650 · Cited by 26
Chourasiya, L., Khatri, S., Lilhore, U. K., Simaiya, S., Alroobaea, R., Baqasah, A. M., Alsafyani, M., & Khan, M. (2025) · Journal of Cloud Computing Advances Systems and Applications · doi:10.1186/s13677-025-00789-y · Cited by 26
Log Anomaly Detection by Adversarial Autoencoders With Graph Feature Fusion
Xie, Y., & Yang, K. (2023) · IEEE Transactions on Reliability · doi:10.1109/tr.2023.3305376 · Cited by 26
Hue: A User-Adaptive Parser for Hybrid Logs
Xu, J., Fu, Q., Zhu, Z., Cheng, Y., Li, Z., Ma, Y., & He, P. (2023) · ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE) · doi:10.1145/3611643.3616260 · Cited by 25
Self-citationMaat: Performance Metric Anomaly Anticipation for Cloud Services with Conditional Diffusion
Lee, C. Q. E., Yang, T., Chen, Z., Su, Y., & Lyu, M. R.-T. (2023) · IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1109/ase56229.2023.00082 · Cited by 24
Self-citationSummarizing Unstructured Logs in Online ServicesPreprint
Meng, W., Zaiter, F., Huang, Y., Liu, Y., Zhang, S., Zhang, Y., Zhu, Y., Zhang, T., Wang, E., Ren, Z., et al. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2012.08938 · Cited by 24
UniLog: Deploy One Model and Specialize it for All Log Analysis TasksPreprint
Zhu, Y., Meng, W., Liu, Y., Zhang, S., Han, T., Tao, S., & Pei, D. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2112.03159 · Cited by 24
AI for IT Operations (AIOps) on Cloud Platforms: Reviews, Opportunities and Challenges
Cheng, Q., Sahoo, D., Saha, A., Yang, W., Liu, C., Woo, G., Singh, M., Saverese, S., & Hoi, S. C. H. (2023) · arXiv · doi:10.48550/arxiv.2304.04661 · Cited by 23
Log Parsing Using LLMs with Self-Generated In-Context Learning and Self-Correction
Wu, Y., Yu, S., & Li, Y. (2025) · IEEE International Conference on Program Comprehension (ICPC) · doi:10.1109/icpc66645.2025.00063 · Cited by 23
Xin, Q. (2026) · JEECS (Journal of Electrical Engineering and Computer Sciences) · doi:10.54732/jeecs.v11i1.3 · Cited by 23
Rhee, M., Zou, J., & Qin, Y. (2024) · AI and Data Science Journal · doi:10.61784/adsj4039 · Cited by 23
Xiao, R., Li, W., Lu, J., & Jin, S. (2024) · IEEE Transactions on Network and Service Management · doi:10.1109/tnsm.2024.3400283 · Cited by 23
Unleashing the True Potential of Semantic-Based Log Parsing with Pre-Trained Language Models
Le, V.-H., Xiao, Y., & Zhang, H. (2025) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1109/icse55347.2025.00174 · Cited by 22
A Theoretical Framework for Understanding the Relationship Between Log Parsing and Anomaly Detection
Shin, D., Khan, Z. A., Bianculli, D., & Briand, L. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-88494-9_16 · Cited by 22
Self-supervised log parsing using semantic contribution difference
Yu, S., Chen, N., Wu, Y., & Dou, W. (2023) · Journal of Systems and Software · doi:10.1016/j.jss.2023.111646 · Cited by 22
Log Parsing with Generalization Ability under New Log Types
Yu, S., Wu, Y., Li, Z., He, P., Chen, N., & Liu, C. (2023) · ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE) · doi:10.1145/3611643.3616355 · Cited by 22
Self-citationMa, X., Zou, H., He, P., Keung, J., Li, Y., Yu, X., & Sarro, F. (2024) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2024.3513413 · Cited by 22
Self-citationLogAI: A Library for Log Analytics and IntelligencePreprint
Cheng, Q., Saha, A., Yang, W., Liu, C., Sahoo, D., & Hoi, S. C. H. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2301.13415 · Cited by 22
Practitioners’ expectations on log anomaly detection
Ma, X., Li, Y., Keung, J., Yu, X., Zou, H., Yang, Z., Sarro, F., & Barr, E. T. (2025) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2025.3586700 · Cited by 21
“He et al. [93] examined the four main steps in the automated log analysis framework: logging, log compression, log parsing, and log mining.”
Li, C., Liu, G., & Zhao, Z. (2026) · Journal of Technology Informatics and Engineering · doi:10.51903/jtie.v5i2.538 · Cited by 21
Defect Prediction via Tree-Based Encoding with Hybrid Granularity for Software Sustainability
Qiu, S., Huang, H., Jiang, W., Zhang, F., & Zhou, W. (2023) · IEEE Transactions on Sustainable Computing · doi:10.1109/tsusc.2023.3248965 · Cited by 21
Self-Evolutionary Group-wise Log Parsing Based on Large Language Model
Pei, C., Liu, Z., Li, J., Zhang, E., Zhang, L., Zhang, H., Chen, W., Pei, D., & Xie, G. (2024) · Proceedings/Proceedings - International Symposium on Software Reliability Engineering · doi:10.1109/issre62328.2024.00016 · Cited by 20
Zhang, L., Jia, T., Jia, M., Liu, H., Yang, Y., Wu, Z., & Li, Y. (2024) · IEEE Transactions on Services Computing · doi:10.1109/tsc.2024.3521675 · Cited by 20
Торський, О. І., & Грицюк, Ю. І. (2025) · Науковий вісник НЛТУ України · doi:10.36930/40350416 · Cited by 19
Accurate and Interpretable Log-Based Fault Diagnosis Using Large Language Models
Sun, Y., Ma, S., Xiao, T., Zhao, Y., Cai, X., Dong, W., Shen, Y., Zhao, Y., Zhang, S., Han, J., et al. (2025) · IEEE Transactions on Services Computing · doi:10.1109/tsc.2025.3599494 · Cited by 19
Robust Procedural Learning for Anomaly Detection and Observability in 5G RAN
Sundqvist, T., Bhuyan, M. H., & Elmroth, E. (2023) · IEEE Transactions on Network and Service Management · doi:10.1109/tnsm.2023.3321401 · Cited by 19
Understanding Solidity Event Logging Practices in the Wild
Li, L., Liang, Y., Liu, Z., & Yu, Z. (2023) · ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE) · doi:10.1145/3611643.3616342 · Cited by 19
Chen, N., Tu, H., Zeng, H., & Ou, Y. (2024) · Knowledge-Based Systems · doi:10.1016/j.knosys.2024.112167 · Cited by 19
Unlocking the Power of Numbers: Log Compression via Numeric Token Parsing
Yu, S., Wu, Y., Li, Y., & He, P. (2024) · IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1145/3691620.3695474 · Cited by 19
Self-citation
Metadata
- Authors
- He, S., He, P., Chen, Z., Yang, T., Su, Y., & Lyu, M. R.
- Affiliations
- Microsoft Research Asia (China) (CN)
- ETH Zurich (CH)
- Chinese University of Hong Kong (HK)
- Venue
- ACM Computing Surveys
- Published
- 2021-07-13
- Volume
- 54
- Issue
- 6
- Pages
- 1-37
- ISSN
- 0360-0300 (ISSN-L)
- 1557-7341
- OpenAlex
- W3183619936
- Cited by
- 334
- References
- 127
- Citations by year
- 2026: 84 · 2025: 84 · 2024: 68 · 2023: 55 · 2022: 29 · 2021: 13
- FWCI
- 18.47
- Type
- journal article
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- ACM Computing Surveys (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Funders
- Research Grants Council of the Hong Kong Special Administrative Region, China (CUHK 14210717)
- Key-Area Research and Development Program of Guangdong Province (2020B010165002)
- Topics
- Physical Sciences › Computer Science › Computer Networks and Communications › Software System Performance and Reliability
- Physical Sciences › Computer Science › Software › Software Reliability and Analysis Research
- Physical Sciences › Computer Science › Computer Networks and Communications › Distributed systems and fault tolerance
- Keywords
- automated log analysis, software logs, log compression, log parsing, event templates, anomaly detection, failure prediction, fault diagnosis, reliability engineering, open-source software toolkit
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.