The DOI matches its Crossref record; 130 of the 130 references it cites were found in a registry or an index.
A Survey on Automated Log Analysis for Reliability Engineering
Open accessAbstract
Logs are semi-structured text generated by logging statements in software source code. In recent decades, software logs have become imperative in the reliability assurance mechanism of many software systems, because they are often the only data available that record software runtime information. As modern software is evolving into a large scale, the volume of logs has increased rapidly. To enable effective and efficient usage of modern software logs in reliability engineering, a number of studies have been conducted on automated log analysis. This survey presents a detailed overview of automated log analysis research, including how to automate and assist the writing of logging statements, how to compress logs, how to parse logs into structured event templates, and how to employ logs to detect anomalies, predict failures, and facilitate diagnosis. Additionally, we survey work that releases open-source toolkits and datasets. Based on the discussion of the recent advances, we present several promising future directions toward real-world and next-generation automated log analysis.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Their importance has grown as modern software systems scale, but the increasing volume and heterogeneity of logs make their analysis a significant challenge [59,60].”
From Anomaly detection and root-cause identification in microservices: a survey (2026) · cites this paper as [59]
Citations
Cites
A fast and elitist multiobjective genetic algorithm: NSGA-II
Deb, K., Pratap, A., Agarwal, S., & Meyarivan, T. (2002) · IEEE Transactions on Evolutionary Computation · doi:10.1109/4235.996017 · Cited by 50,053
Distributed Representations of Words and Phrases and their Compositionality
Mikolov, T., Sutskever, I., Chen, K., Corrado, G., & Dean, J. (2013) · arXiv · doi:10.48550/arxiv.1310.4546 · Cited by 24,533 · cited 1×
“NY •Log event sequence: A sequence of log events recording system’s activities. Particularly, each element can simply be the log event ID or log embedding vector, e.g., learned by word2vec algorithms [111]. •Log event count vector: A feature vector recording the log events occurrence in a log partition, where each fea…”
BackgroundKiczales, G., Lamping, J., Mendhekar, A., Maeda, C., Lopes, C., Loingtier, J.-M., & Irwin, J. (1997) · Lecture Notes in Computer Science · doi:10.1007/bfb0053381 · Cited by 2,573
DeepLog: Anomaly Detection and Diagnosis from System Logs through Deep Learning
Du, M., Li, F., Zheng, G., & Srikumar, V. (2017) · Proceedings of the 2017 ACM SIGSAC Conference on Computer and Communications Security · doi:10.1145/3133956.3134015 · Cited by 1,835
Detecting large-scale system problems by mining console logs
Xu, W., Huang, L., Fox, A., Patterson, D., & Jordan, M. I. (2009) · Proceedings of the ACM SIGOPS 22nd symposium on Operating systems principles · doi:10.1145/1629575.1629587 · Cited by 1,332 · cited 5×
“en-source implementation of existing log parsers, this survey focuses on the methodological comparison of these parsers. In additional, while parsing rules can be constructed by analyzing source code [144], we focus on parsers that only utilize logs as input. Mode. Mode is the most important log parsing characteristic…”
BackgroundMethodInfluentialThe Daikon system for dynamic detection of likely invariants
Ernst, M. D., Perkins, J. H., Guo, P. J., McCamant, S., Pacheco, C., Tschantz, M. S., & Xiao, C. (2007) · Science of Computer Programming · doi:10.1016/j.scico.2007.01.015 · Cited by 1,080
Dynamically discovering likely program invariants to support program evolution
Ernst, M. D., Cockrell, J., Griswold, W. G., & Notkin, D. (2001) · IEEE Transactions on Software Engineering · doi:10.1109/32.908957 · Cited by 1,050
Drain: an online log parsing approach with fixed depth tree
He, P., Zhu, J., Zheng, Z., & Lyu, M. R. (2017) · 2017 IEEE International Conference on Web Services (ICWS) · doi:10.1109/icws.2017.13 · Cited by 943 · cited 2×
“P [59] All Yes Iterative partitioning MoLFI [108] All Yes Evolutionary algorithms Online SHISO [113] All No Clustering LenMa [131] All No Clustering Spell [41] All No Longest common subsequence Drain [60, 61] All Yes Heuristics Logram [33] All Yes Frequent pattern mining 5.2 Log Parser Characteristics We explore 15 ex…”
MethodInfluentialSelf-citationLSCs: Breathing Life into Message Sequence Charts
Damm, W., & Harel, D. (2001) · Formal Methods in System Design · doi:10.1023/a:1011227529550 · Cited by 818
Robust log-based anomaly detection on unstable log data
Zhang, X., Xu, Y., Lin, Q., Qiao, B., Zhang, H., Dang, Y., Xie, C., Yang, X., Cheng, Q., Li, Z., et al. (2019) · Proceedings of the 2019 27th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering · doi:10.1145/3338906.3338931 · Cited by 761 · cited 3×
“Poorly written static text and inconsistent dynamic content could affect the subsequent diagnosis and maintenance activities [86, 111, 136, 196].”
BackgroundMethod
Research works printed but not linked: 47
- Anunay Amar and Peter C. Rigby . 2019. Mining historical test logs to predict bugs and localize faults in the test logs . In Proceedings of the IEEE/ACM 41st International Conference on Software Engineering (ICSE’19) . 140--151. Anunay Amar and Peter C. Rigby. 2019. Mining historical test logs to predict bugs and localize faults in the test logs. In Proceedings of the IEEE/ACM 41st International Conference on Software Engineering (ICSE’19). 140--151.
- Raju Balakrishnan and Ramendra K. Sahoo . 2006. Lossless compression for large scale cluster logs . In Proceedings 20th IEEE International Parallel & Distributed Processing Symposium (IPDPS’06) . 7. Raju Balakrishnan and Ramendra K. Sahoo. 2006. Lossless compression for large scale cluster logs. In Proceedings 20th IEEE International Parallel & Distributed Processing Symposium (IPDPS’06). 7.
- Ivan Beschastnikh , Yuriy Brun , Sigurd Schneider , Michael Sloan , and Michael D. Ernst . 2011. Leveraging existing instrumentation to automatically infer invariant-constrained models . In Proceedings of the 19th ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE’11) . 267--277. Ivan Beschastnikh, Yuriy Brun, Sigurd Schneider, Michael Sloan, and Michael D. Ernst. 2011. Leveraging existing instrumentation to automatically infer invariant-constrained models. In Proceedings of the 19th ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE’11). 267--277.
- CFDR. 2020. Computer failure data repository. Retrieved from https://www.usenix.org/cfdr. CFDR. 2020. Computer failure data repository. Retrieved from https://www.usenix.org/cfdr.
- Edward Chuah , Shyh-hao Kuo, Paul Hiew , William-Chandra Tjhi , Gary Lee , John Hammond , Marek T. Michalewicz , Terence Hung , and James C. Browne . 2010. Diagnosing the root-causes of failures from cluster log files . In Proceedings of the International Conference on High Performance Computing (HPC’10) . 1--10. Edward Chuah, Shyh-hao Kuo, Paul Hiew, William-Chandra Tjhi, Gary Lee, John Hammond, Marek T. Michalewicz, Terence Hung, and James C. Browne. 2010. Diagnosing the root-causes of failures from cluster log files. In Proceedings of the International Conference on High Performance Computing (HPC’10). 1--10.
- Sebastian Deorowicz and Szymon Grabowski . 2008 . Sub-atomic field processing for improved web log compression . In Proceedings of the IEEE International Conference on “Modern Problems of Radio Engineering, Telecommunications and Computer Science” (TCSET’08) . 551--556. Sebastian Deorowicz and Szymon Grabowski. 2008. Sub-atomic field processing for improved web log compression. In Proceedings of the IEEE International Conference on “Modern Problems of Radio Engineering, Telecommunications and Computer Science” (TCSET’08). 551--556.
- Rui Ding , Hucheng Zhou , Jian-Guang Lou , Hongyu Zhang , Qingwei Lin , Qiang Fu , Dongmei Zhang , and Tao Xie . 2015 . Log2: A cost-aware logging mechanism for performance diagnosis . In Proceedings of the USENIX Annual Technical Conference (ATC). 139--150 . Rui Ding, Hucheng Zhou, Jian-Guang Lou, Hongyu Zhang, Qingwei Lin, Qiang Fu, Dongmei Zhang, and Tao Xie. 2015. Log2: A cost-aware logging mechanism for performance diagnosis. In Proceedings of the USENIX Annual Technical Conference (ATC). 139--150.
- Stephen E. Hansen and E. Todd Atkins . 1993. Automated system monitoring and notification with swatch . In Proceedings of the 7th USENIX Large Installation System Administration Conference (LISA’93) , Vol. 93 . 145--152. Stephen E. Hansen and E. Todd Atkins. 1993. Automated system monitoring and notification with swatch. In Proceedings of the 7th USENIX Large Installation System Administration Conference (LISA’93), Vol. 93. 145--152.
- Pinjia He , Zhuangbin Chen , Shilin He , and Michael R. Lyu . 2018. Characterizing the natural language descriptions in software logging statements . In Proceedings of the 33rd ACM/IEEE International Conference on Automated Software Engineering (ASE’18) . 178--189. Pinjia He, Zhuangbin Chen, Shilin He, and Michael R. Lyu. 2018. Characterizing the natural language descriptions in software logging statements. In Proceedings of the 33rd ACM/IEEE International Conference on Automated Software Engineering (ASE’18). 178--189.
- Pinjia He , Jieming Zhu , Pengcheng Xu , Zibin Zheng , and Michael R . Lyu . 2018 . A directed acyclic graph approach to online log parsing. Retrieved from https://arXiv:1806.04356. Pinjia He, Jieming Zhu, Pengcheng Xu, Zibin Zheng, and Michael R. Lyu. 2018. A directed acyclic graph approach to online log parsing. Retrieved from https://arXiv:1806.04356.
- Shilin He , Jieming Zhu , Pinjia He , and Michael R. Lyu . 2016. Experience report: System log analysis for anomaly detection . In Proceedings of the 27th IEEE International Symposium on Software Reliability Engineering (ISSRE’16) . 207--218. Shilin He, Jieming Zhu, Pinjia He, and Michael R. Lyu. 2016. Experience report: System log analysis for anomaly detection. In Proceedings of the 27th IEEE International Symposium on Software Reliability Engineering (ISSRE’16). 207--218.
- Shilin He , Jieming Zhu , Pinjia He , and Michael R . Lyu . 2020 . Loghub : A Large Collection of System Log Datasets towards Automated Log Analytics. Retrieved from https://arXiv:2008.06448. Shilin He, Jieming Zhu, Pinjia He, and Michael R. Lyu. 2020. Loghub: A Large Collection of System Log Datasets towards Automated Log Analytics. Retrieved from https://arXiv:2008.06448.
- 10.5555/1525908.1525912 · doi:10.5555/1525908.1525912
- Zhen Ming Jiang , Ahmed E. Hassan , Parminder Flora , and Gilbert Hamann . 2008 . Abstracting execution logs to execution events for enterprise applications . In Proceedings of the 8th International Conference on Quality Software (QSIC). Zhen Ming Jiang, Ahmed E. Hassan, Parminder Flora, and Gilbert Hamann. 2008. Abstracting execution logs to execution events for enterprise applications. In Proceedings of the 8th International Conference on Quality Software (QSIC).
- Suhas Kabinna , Cor-Paul Bezemer , Weiyi Shang , and Ahmed E. Hassan . 2016. Logging library migrations: A case study for the apache software foundation projects . In Proceedings of the 13th International Conference on Mining Software Repositories (MSR’16) . 154--164. Suhas Kabinna, Cor-Paul Bezemer, Weiyi Shang, and Ahmed E. Hassan. 2016. Logging library migrations: A case study for the apache software foundation projects. In Proceedings of the 13th International Conference on Mining Software Repositories (MSR’16). 154--164.
- Suhas Kabinna , Cor-Paul Bezemer , Weiyi Shang , Mark D. Syer , and Ahmed E . Hassan . 2018 . Examining the stability of logging statements. Empir. Softw. Eng . (2018), 290--333. Suhas Kabinna, Cor-Paul Bezemer, Weiyi Shang, Mark D. Syer, and Ahmed E. Hassan. 2018. Examining the stability of logging statements. Empir. Softw. Eng. (2018), 290--333.
- Soila P. Kavulya , Kaustubh Joshi , Felicita Di Giandomenico, and Priya Narasimhan . 2012 . Failure diagnosis of complex systems. In Resilience Assessment and Evaluation of Computing Systems. Springer , 239--261. Soila P. Kavulya, Kaustubh Joshi, Felicita Di Giandomenico, and Priya Narasimhan. 2012. Failure diagnosis of complex systems. In Resilience Assessment and Evaluation of Computing Systems. Springer, 239--261.
- Suleman Khan , Abdullah Gani , Ainuddin Wahid Abdul Wahab , Mustapha Aminu Bagiwa, Muhammad Shiraz, Samee U. Khan, Rajkumar Buyya, and Albert Y. Zomaya. 2016 . Cloud log forensics: Foundations, state of the art, and future directions. ACM Comput. Surveys ( 2016), 178--184. Suleman Khan, Abdullah Gani, Ainuddin Wahid Abdul Wahab, Mustapha Aminu Bagiwa, Muhammad Shiraz, Samee U. Khan, Rajkumar Buyya, and Albert Y. Zomaya. 2016. Cloud log forensics: Foundations, state of the art, and future directions. ACM Comput. Surveys (2016), 178--184.
- Jean-Claude Laprie . 1995 . Dependable computing: Concepts, limits, challenges . In Proceedings of the 25th International Symposium on Fault-tolerant Computing (FTCS’95) . 42--54. Jean-Claude Laprie. 1995. Dependable computing: Concepts, limits, challenges. In Proceedings of the 25th International Symposium on Fault-tolerant Computing (FTCS’95). 42--54.
- Heng Li , Tse-Hsun (Peter) Chen , Weiyi Shang , and Ahmed E . Hassan . 2018 . Studying software logging using topic models. Empir. Softw. Eng . (2018), 2655--2694. Heng Li, Tse-Hsun (Peter) Chen, Weiyi Shang, and Ahmed E. Hassan. 2018. Studying software logging using topic models. Empir. Softw. Eng. (2018), 2655--2694.
- Heng Li , Weiyi Shang , and Ahmed E . Hassan . 2017 . Which log level should developers choose for a new logging statement?Empir. Softw. Eng . (2017), 1684--1716. Heng Li, Weiyi Shang, and Ahmed E. Hassan. 2017. Which log level should developers choose for a new logging statement?Empir. Softw. Eng. (2017), 1684--1716.
- Heng Li , Weiyi Shang , Ying Zou , and Ahmed E . Hassan . 2017 . Towards just-in-time suggestions for log changes. Empir. Softw. Eng . (2017), 1831--1865. Heng Li, Weiyi Shang, Ying Zou, and Ahmed E. Hassan. 2017. Towards just-in-time suggestions for log changes. Empir. Softw. Eng. (2017), 1831--1865.
- Chinghway Lim , Navjot Singh , and Shalini Yajnik . 2008 . A log mining approach to failure analysis of enterprise telephony systems . In Proceedings of the 38th IEEE/IFIP International Conference on Dependable Systems and Networks (DSN’08) . Chinghway Lim, Navjot Singh, and Shalini Yajnik. 2008. A log mining approach to failure analysis of enterprise telephony systems. In Proceedings of the 38th IEEE/IFIP International Conference on Dependable Systems and Networks (DSN’08).
- Jinyang Liu , Jieming Zhu , Shilin He , Pinjia He , Zibin Zheng , and Michael R. Lyu . 2019. Logzip: Extracting hidden structures via iterative clustering for log compression . In Proceedings of the 34th IEEE/ACM International Conference on Automated Software Engineering (ASE’19) . 863--873. Jinyang Liu, Jieming Zhu, Shilin He, Pinjia He, Zibin Zheng, and Michael R. Lyu. 2019. Logzip: Extracting hidden structures via iterative clustering for log compression. In Proceedings of the 34th IEEE/ACM International Conference on Automated Software Engineering (ASE’19). 863--873.
- Zhongxin Liu Xin Xia David Lo Zhenchang Xing Ahmed E. Hassan and Shanping Li. 2019. Which variables should I log?IEEE Trans. Softw. Eng. (2019). Zhongxin Liu Xin Xia David Lo Zhenchang Xing Ahmed E. Hassan and Shanping Li. 2019. Which variables should I log?IEEE Trans. Softw. Eng. (2019).
- Joshua Lockerman , Jose M. Faleiro , Juno Kim , Soham Sankaran , Daniel J. Abadi , James Aspnes , Siddhartha Sen , and Mahesh Balakrishnan . 2018 . The fuzzylog: A partially ordered shared log . In Proceedings of the 13th USENIX Symposium on Operating Systems Design and Implementation (OSDI’18) . 357--372. Joshua Lockerman, Jose M. Faleiro, Juno Kim, Soham Sankaran, Daniel J. Abadi, James Aspnes, Siddhartha Sen, and Mahesh Balakrishnan. 2018. The fuzzylog: A partially ordered shared log. In Proceedings of the 13th USENIX Symposium on Operating Systems Design and Implementation (OSDI’18). 357--372.
- Jian-Guang Lou , Qiang Fu , Shengqi Yang , Ye Xu , and Jiang Li . 2010 . Mining invariants from console logs for system problem detection . In Proceedings of the USENIX Annual Technical Conference (ATC’10) . 1--14. Jian-Guang Lou, Qiang Fu, Shengqi Yang, Ye Xu, and Jiang Li. 2010. Mining invariants from console logs for system problem detection. In Proceedings of the USENIX Annual Technical Conference (ATC’10). 1--14.
- Liang Luo , Suman Nath , Lenin Ravindranath Sivalingam , Madan Musuvathi , and Luis Ceze . 2018 . Troubleshooting transiently recurring errors in production systems with blame-proportional logging . In Proceedings of the USENIX Annual Technical Conference (ATC’18) . 321--334. Liang Luo, Suman Nath, Lenin Ravindranath Sivalingam, Madan Musuvathi, and Luis Ceze. 2018. Troubleshooting transiently recurring errors in production systems with blame-proportional logging. In Proceedings of the USENIX Annual Technical Conference (ATC’18). 321--334.
- Michael R. Lyu (ed.). 1996. Handbook of Software Reliability Engineering. IEEE Computer Society Press. Michael R. Lyu (ed.). 1996. Handbook of Software Reliability Engineering. IEEE Computer Society Press.
- Adetokunbo Makanju , A. Nur Zincir-Heywood , and Evangelos E . Milios . 2012 . A lightweight algorithm for message type extraction in system application logs. IEEE Trans. Knowl. Data Eng . (2012). Adetokunbo Makanju, A. Nur Zincir-Heywood, and Evangelos E. Milios. 2012. A lightweight algorithm for message type extraction in system application logs. IEEE Trans. Knowl. Data Eng. (2012).
- Adetokunbo A. O. Makanju , A. Nur Zincir-Heywood , and Evangelos E. Milios . 2009. Clustering event logs using iterative partitioning . In Proceedings of International Conference on Knowledge Discovery and Data Mining (KDD’09) . 1255--1264. Adetokunbo A. O. Makanju, A. Nur Zincir-Heywood, and Evangelos E. Milios. 2009. Clustering event logs using iterative partitioning. In Proceedings of International Conference on Knowledge Discovery and Data Mining (KDD’09). 1255--1264.
- Meiyappan Nagappan and Mladen A. Vouk . 2010. Abstracting log lines to log event types for mining software system logs . In Proceedings of the 7th IEEE Working Conference on Mining Software Repositories (MSR’10) . 114--117. Meiyappan Nagappan and Mladen A. Vouk. 2010. Abstracting log lines to log event types for mining software system logs. In Proceedings of the 7th IEEE Working Conference on Mining Software Repositories (MSR’10). 114--117.
- Karthik Nagaraj , Charles Killian , and Jennifer Neville . 2012 . Structured comparative analysis of systems logs to diagnose performance problems . In Proceedings of the 9th USENIX Symposium on Networked Systems Design and Implementation (NSDI’12) . 353--366. Karthik Nagaraj, Charles Killian, and Jennifer Neville. 2012. Structured comparative analysis of systems logs to diagnose performance problems. In Proceedings of the 9th USENIX Symposium on Networked Systems Design and Implementation (NSDI’12). 353--366.
- Adam J. Oliner , Archana Ganapathi , and Wei Xu. 2012. Advances and challenges in log analysis. ACM Communication ( 2012 ), 55--61. Adam J. Oliner, Archana Ganapathi, and Wei Xu. 2012. Advances and challenges in log analysis. ACM Communication (2012), 55--61.
- James E. Prewett . 2003 . Analyzing cluster log files using logsurfer . In Proceedings of the 4th Annual Conference on Linux Clusters. Citeseer. James E. Prewett. 2003. Analyzing cluster log files using logsurfer. In Proceedings of the 4th Annual Conference on Linux Clusters. Citeseer.
- John P. Rouillard . 2004 . Real-time log file analysis using the simple event correlator (sec) . In Proceedings of the 18th USENIX Large Installation System Administration Conference (LISA’04) , Vol. 4 . 133--150. John P. Rouillard. 2004. Real-time log file analysis using the simple event correlator (sec). In Proceedings of the 18th USENIX Large Installation System Administration Conference (LISA’04), Vol. 4. 133--150.
- Bianca Schroeder and Garth A. Gibson . 2006. A large-scale study of failures in high-performance computing systems . In Proceedings of the International Conference on Dependable Systems and Networks (DSN’06) . 249--258. Bianca Schroeder and Garth A. Gibson. 2006. A large-scale study of failures in high-performance computing systems. In Proceedings of the International Conference on Dependable Systems and Networks (DSN’06). 249--258.
- Weiyi Shang , Meiyappan Nagappan , and Ahmed E . Hassan . 2015 . Studying the relationship between logging characteristics and the code quality of platform software. Empir. Softw. Eng . (2015), 1--27. Weiyi Shang, Meiyappan Nagappan, and Ahmed E. Hassan. 2015. Studying the relationship between logging characteristics and the code quality of platform software. Empir. Softw. Eng. (2015), 1--27.
- Keiichi Shima. 2016. Length matters: Clustering system log messages using length of words. Retrieved from https://arXiv:1611.03213. Keiichi Shima. 2016. Length matters: Clustering system log messages using length of words. Retrieved from https://arXiv:1611.03213.
- Przemysław Skibiński and Jakub Swacha . 2007 . Fast and efficient log file compression . In Proceedings of 11th East-European Conference on Advances in Databases and Information Systems (ADBIS’07) . 56--69. Przemysław Skibiński and Jakub Swacha. 2007. Fast and efficient log file compression. In Proceedings of 11th East-European Conference on Advances in Databases and Information Systems (ADBIS’07). 56--69.
- Wil Van Der Aalst . 2012. Process mining. Commun. ACM ( 2012 ), 76--83. Wil Van Der Aalst. 2012. Process mining. Commun. ACM (2012), 76--83.
- Stephen Yang , Seo Jin Park , and John K. Ousterhout . 2018. NanoLog: A nanosecond scale logging system . In Proceedings of the USENIX Annual Technical Conference (ATC). 335--350 . Stephen Yang, Seo Jin Park, and John K. Ousterhout. 2018. NanoLog: A nanosecond scale logging system. In Proceedings of the USENIX Annual Technical Conference (ATC). 335--350.
- Kundi Yao , Guilherme B. de Pádua , Weiyi Shang , Catalin Sporea , Andrei Toma , and Sarah Sajedi . 2020. Log4Perf: Suggesting and updating logging locations for web-based systems ’ performance monitoring. Empir. Softw. Eng . ( 2020 ), 488--531. Kundi Yao, Guilherme B. de Pádua, Weiyi Shang, Catalin Sporea, Andrei Toma, and Sarah Sajedi. 2020. Log4Perf: Suggesting and updating logging locations for web-based systems’ performance monitoring. Empir. Softw. Eng. (2020), 488--531.
- Kundi Yao , Heng Li , Weiyi Shang , and Ahmed E . Hassan . 2019 . A study of the performance of general compressors on log files. Empir. Softw. Eng . (2019), 3043--3085. Kundi Yao, Heng Li, Weiyi Shang, and Ahmed E. Hassan. 2019. A study of the performance of general compressors on log files. Empir. Softw. Eng. (2019), 3043--3085.
- 10.5555/2337223.2337236 · doi:10.5555/2337223.2337236
- Xu Zhao , Kirk Rodrigues , Yu Luo , Ding Yuan , and Michael Stumm . 2016 . Non-intrusive performance profiling for entire software stacks based on the flow reconstruction principle . In Proceedings of the 12th Symposium on Operating Systems Design and Implementation (OSDI’16) . 603--618. Xu Zhao, Kirk Rodrigues, Yu Luo, Ding Yuan, and Michael Stumm. 2016. Non-intrusive performance profiling for entire software stacks based on the flow reconstruction principle. In Proceedings of the 12th Symposium on Operating Systems Design and Implementation (OSDI’16). 603--618.
- Jieming Zhu , Shilin He , Jinyang Liu , Pinjia He , Qi Xie , Zibin Zheng , and Michael R. Lyu . 2019. Tools and benchmarks for automated log parsing . In Proceedings of the 41st International Conference on Software Engineering: Software Engineering in Practice (ICSE-SEIP’19) . 121--130. Jieming Zhu, Shilin He, Jinyang Liu, Pinjia He, Qi Xie, Zibin Zheng, and Michael R. Lyu. 2019. Tools and benchmarks for automated log parsing. In Proceedings of the 41st International Conference on Software Engineering: Software Engineering in Practice (ICSE-SEIP’19). 121--130.
Cited by
Loghub: a large collection of system log datasets for AI-driven log analytics
Zhu, J., He, S., He, P., Liu, J., & Lyu, M. R. (2023) · 2023 IEEE 34th International Symposium on Software Reliability Engineering (ISSRE) · doi:10.1109/issre59848.2023.00071 · Cited by 302
Self-citationLog-based anomaly detection with deep learning: how far are we?
Le, V.-H., & Zhang, H. (2022) · Proceedings of the 44th International Conference on Software Engineering · doi:10.1145/3510003.3510155 · Cited by 257
Experience Report: Deep Learning-based System Log Analysis for Anomaly DetectionPreprint
Chen, Z., Liu, J., Gu, W., Su, Y., & Lyu, M. R.-T. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2107.05908 · Cited by 229
Self-citationLogGPT: Exploring ChatGPT for Log-Based Anomaly Detection
Qi, J., Huang, S., Luan, Z., Yang, S., Fung, C., Yang, H., Qian, D., Shang, J., Xiao, Z., & Wu, Z. (2023) · IEEE International Conference on High Performance Computing and Communications; IEEE International Conference on Smart City; IEEE International Conference on Data Science and Systems (HPCC/SmartCity/DSS) · doi:10.1109/hpcc-dss-smartcity-dependsys60770.2023.00045 · Cited by 203
LLMParser: An Exploratory Study on Using Large Language Models for Log Parsing
Ma, Z., Chen, A. R., Kim, D. J., Chen, T.-H. P., & Wang, S. (2024) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1145/3597503.3639150 · Cited by 177
Metadata
- Authors
- He, S., He, P., Chen, Z., Yang, T., Su, Y., & Lyu, M. R.
- Affiliations
- Microsoft Research Asia (China) (CN)
- ETH Zurich (CH)
- Chinese University of Hong Kong (HK)
- Venue
- ACM Computing Surveys
- Published
- 2021-07-13
- Volume
- 54
- Issue
- 6
- Pages
- 1-37
- ISSN
- 0360-0300 (ISSN-L)
- 1557-7341
- OpenAlex
- W3183619936
- Cited by
- 334
- References
- 127
- Citations by year
- 2026: 84 · 2025: 84 · 2024: 68 · 2023: 55 · 2022: 29 · 2021: 13
- FWCI
- 18.47
- Type
- journal article
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- ACM Computing Surveys (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Funders
- Research Grants Council of the Hong Kong Special Administrative Region, China (CUHK 14210717)
- Key-Area Research and Development Program of Guangdong Province (2020B010165002)
- Topics
- Physical Sciences › Computer Science › Computer Networks and Communications › Software System Performance and Reliability
- Physical Sciences › Computer Science › Software › Software Reliability and Analysis Research
- Physical Sciences › Computer Science › Computer Networks and Communications › Distributed systems and fault tolerance
- Keywords
- automated log analysis, software logs, log compression, log parsing, event templates, anomaly detection, failure prediction, fault diagnosis, reliability engineering, open-source software toolkit
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: A Survey on Automated Log Analysis for Reliability Engineering. https://app.cochat.ai/papers/10.1145/3460345
- The paper
- He, S., He, P., Chen, Z., Yang, T., Su, Y., & Lyu, M. R. (2022). A Survey on Automated Log Analysis for Reliability Engineering. ACM Computing Surveys. https://doi.org/10.1145/3460345
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.