CoChat
Sign Up
PreprintCited by 27Software System Performance and ReliabilityCloud Computing and Resource ManagementSoftware Engineering Research

AI for IT Operations (AIOps) on Cloud Platforms: Reviews, Opportunities and Challenges

Open access
Cheng, Qian, Sahoo, Doyen, Saha, Amrita, Yang, Wenzhuo, Liu, Chenghao, Woo, Gerald, Singh, Manpreet, Saverese, Silvio +1 more·2023·arXiv
DOI 10.48550/arxiv.2304.04661arXiv 2304.04661
Open this paper in CoChat — free accountOpen PDF

Abstract

Artificial Intelligence for IT operations (AIOps) aims to combine the power of AI with the big data generated by IT Operations processes, particularly in cloud infrastructures, to provide actionable insights with the primary goal of maximizing availability. There are a wide variety of problems to address, and multiple use-cases, where AI capabilities can be leveraged to enhance operational efficiency. Here we provide a review of the AIOps vision, trends challenges and opportunities, specifically focusing on the underlying AI techniques. We discuss in depth the key types of data emitted by IT Operations activities, the scale and challenges in analyzing them, and where they can be helpful. We categorize the key AIOps tasks as - incident detection, failure prediction, root cause analysis and automated actions. We discuss the problem formulation for each task, and then present a taxonomy of techniques to solve these problems. We also identify relatively under explored topics, especially those that could significantly benefit from advances in AI literature. We also provide insights into the trends in this field, and what are the key investment opportunities.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

DataCite · 10.48550/arxiv.2304.04661

Cites

0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

The publisher hasn’t deposited this paper’s reference list.

Research works printed but not linked: 162

  1. S. Siddique, "The road to enterprise artificial intelligence: A case studies driven exploration," Ph.D. dissertation, 05 2018.
  2. N. Sabharwal, Hands-on AIOps. Springer, 2022.
  3. Y. Dang, Q. Lin, and P. Huang, "Aiops: Real-world challenges and re- search innovations," in 2019 IEEE/ACM 41st International Conference on Software Engineering: Companion Proceedings (ICSE-Companion), 2019, pp. 4-5.
  4. L. Rijal, R. Colomo-Palacios, and M. Sánchez-Gordón, "Aiops: A multivocal literature review," Artificial Intelligence for Cloud and Edge Computing, pp. 31-50, 2022.
  5. R. Chalapathy and S. Chawla, "Deep learning for anomaly detection: A survey," arXiv preprint arXiv:1901.03407, 2019. · arXiv
  6. L. Akoglu, H. Tong, and D. Koutra, "Graph based anomaly detection and description: a survey," Data mining and knowledge discovery, vol. 29, no. 3, pp. 626-688, 2015.
  7. J. Soldani and A. Brogi, "Anomaly detection and failure root cause analysis in (micro)service-based cloud applications: A survey," 2021. [Online]. Available: https://arxiv.org/abs/2105.12378 · arXiv
  8. V. Davidovski, "Exponential innovation through digital transfor- mation," in Proceedings of the 3rd International Conference on Applications in Information Technology, ser. ICAIT'2018. New York, NY, USA: Association for Computing Machinery, 2018, p. 3-5. [Online]. Available: https://doi.org/10.1145/3274856.3274858 · DOI
  9. D. S. Battina, "Ai and devops in information technology and its future in the united states," INTERNATIONAL JOURNAL OF CREATIVE RESEARCH THOUGHTS (IJCRT), ISSN, pp. 2320-2882, 2021.
  10. A. B. Yoo, M. A. Jette, and M. Grondona, "Slurm: Simple linux utility for resource management," in Workshop on job scheduling strategies for parallel processing. Springer, 2003, pp. 44-60.
  11. Y. Zhu, W. Meng, Y. Liu, S. Zhang, T. Han, S. Tao, and D. Pei, "Unilog: Deploy one model and specialize it for all log analysis tasks," CoRR, vol. abs/2112.03159, 2021. [Online]. Available: https://arxiv.org/abs/2112.03159 · arXiv
  12. L. Korzeniowski and K. Goczyla, "Landscape of automated log anal- ysis: A systematic literature review and mapping study," IEEE Access, vol. 10, pp. 21 892-21 913, 2022.
  13. M. Sheldon and G. V. B. Weissman, "Retrace: Collecting execution trace with virtual machine deterministic replay," in Proceedings of the Third Annual Workshop on Modeling, Benchmarking and Simulation (MoBS 2007). Citeseer, 2007.
  14. R. Fonseca, G. Porter, R. H. Katz, and S. Shenker, "{X-Trace}: A pervasive network tracing framework," in 4th USENIX Symposium on Networked Systems Design & Implementation (NSDI 07), 2007.
  15. J. Zhou, Z. Chen, J. Wang, Z. Zheng, and M. R. Lyu, "Trace bench: An open data set for trace-oriented monitoring," in 2014 IEEE 6th International Conference on Cloud Computing Technology and Science. IEEE, 2014, pp. 519-526.
  16. M. Braei and S. Wagner, "Anomaly detection in univariate time-series: A survey on the state-of-the-art," ArXiv, vol. abs/2004.00433, 2020. · arXiv
  17. A. Blázquez-García, A. Conde, U. Mori, and J. A. Lozano, "A review on outlier/anomaly detection in time series data," ACM Computing Surveys (CSUR), vol. 54, no. 3, pp. 1-33, 2021.
  18. K. Choi, J. Yi, C. Park, and S. Yoon, "Deep learning for anomaly detection in time-series data: review, analysis, and guidelines," IEEE Access, 2021.
  19. D. Liu, Y. Zhao, H. Xu, Y. Sun, D. Pei, J. Luo, X. Jing, and M. Feng, "Opprentice: Towards practical and automatic anomaly de- tection through machine learning," in Proceedings of the 2015 internet measurement conference, 2015, pp. 211-224.
  20. J. Gao, X. Song, Q. Wen, P. Wang, L. Sun, and H. Xu, "Robusttad: Robust time series anomaly detection via decomposition and convolu- tional neural networks," arXiv preprint arXiv:2002.09545, 2020. · arXiv
  21. S. Han, X. Hu, H. Huang, M. Jiang, and Y. Zhao, "ADBench: Anomaly detection benchmark," in Thirty-sixth Conference on Neural Information Processing Systems Datasets and Benchmarks Track, 2022. [Online]. Available: https://openreview.net/forum?id=foA SFQ9zo0
  22. Z. Li, N. Zhao, S. Zhang, Y. Sun, P. Chen, X. Wen, M. Ma, and D. Pei, "Constructing large-scale real-world benchmark datasets for aiops," arXiv preprint arXiv:2208.03938, 2022. · arXiv
  23. R. Wu and E. J. Keogh, "Current time series anomaly detection benchmarks are flawed and are creating the illusion of progress," CoRR, vol. abs/2009.13807, 2020. [Online]. Available: https://arxiv. org/abs/2009.13807 · arXiv
  24. H. Xu, W. Chen, N. Zhao, Z. Li, J. Bu, Z. Li, Y. Liu, Y. Zhao, D. Pei, Y. Feng et al., "Unsupervised anomaly detection via variational auto- encoder for seasonal kpis in web applications," in Proceedings of the 2018 world wide web conference, 2018, pp. 187-196.
  25. J. Bu, Y. Liu, S. Zhang, W. Meng, Q. Liu, X. Zhu, and D. Pei, "Rapid deployment of anomaly detection models for large number of emerging kpi streams," in 2018 IEEE 37th International Performance Computing and Communications Conference (IPCCC). IEEE, 2018, pp. 1-8.
  26. T. Huang, P. Chen, and R. Li, "A semi-supervised vae based active anomaly detection framework in multivariate time series for online systems," in Proceedings of the ACM Web Conference 2022, 2022, pp. 1797-1806.
  27. X.-L. Li and B. Liu, "Learning from positive and unlabeled examples with different data distributions," in European conference on machine learning. Springer, 2005, pp. 218-229.
  28. X. Zhang, J. Kim, Q. Lin, K. Lim, S. O. Kanaujia, Y. Xu, K. Jamieson, A. Albarghouthi, S. Qin, M. J. Freedman et al., "Cross-dataset time series anomaly detection for cloud systems," in 2019 USENIX Annual Technical Conference (USENIX ATC 19), 2019, pp. 1063-1076.
  29. N. Laptev, S. Amizadeh, and I. Flint, "Generic and scalable framework for automated time-series anomaly detection," in Proceedings of the 21th ACM SIGKDD international conference on knowledge discovery and data mining, 2015, pp. 1939-1947.
  30. S. Guha, N. Mishra, G. Roy, and O. Schrijvers, "Robust random cut forest based anomaly detection on streams," in International conference on machine learning. PMLR, 2016, pp. 2712-2721.
  31. S. Ahmad, A. Lavin, S. Purdy, and Z. Agha, "Unsupervised real-time anomaly detection for streaming data," Neurocomputing, vol. 262, pp. 134-147, 2017.
  32. J. Audibert, P. Michiardi, F. Guyard, S. Marti, and M. A. Zuluaga, "Usad: Unsupervised anomaly detection on multivariate time series," in Proceedings of the 26th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, 2020, pp. 3395-3404.
  33. Y. Su, Y. Zhao, C. Niu, R. Liu, W. Sun, and D. Pei, "Robust anomaly detection for multivariate time series through stochastic recurrent neural network," in Proceedings of the 25th ACM SIGKDD international conference on knowledge discovery & data mining, 2019, pp. 2828- 2837.
  34. Z. Li, Y. Zhao, J. Han, Y. Su, R. Jiao, X. Wen, and D. Pei, "Multivariate time series anomaly detection and interpretation using hierarchical inter-metric and temporal embedding," in Proceedings of the 27th ACM SIGKDD Conference on Knowledge Discovery & Data Mining, 2021, pp. 3220-3230.
  35. W. Yang, K. Zhang, and S. C. Hoi, "Causality-based multivariate time series anomaly detection," arXiv preprint arXiv:2206.15033, 2022. · arXiv
  36. F. Ayed, L. Stella, T. Januschowski, and J. Gasthaus, "Anomaly detection at scale: The case for deep distributional time series models," in International Conference on Service-Oriented Computing. Springer, 2020, pp. 97-109.
  37. S. Rabanser, T. Januschowski, K. Rasul, O. Borchert, R. Kurle, J. Gasthaus, M. Bohlke-Schneider, N. Papernot, and V. Flunkert, "In- trinsic anomaly detection for multi-variate time series," arXiv preprint arXiv:2206.14342, 2022. · arXiv
  38. J. Hochenbaum, O. S. Vallis, and A. Kejariwal, "Automatic anomaly detection in the cloud via statistical learning," arXiv preprint arXiv:1704.07706, 2017. · arXiv
  39. H. Ren, B. Xu, Y. Wang, C. Yi, C. Huang, X. Kou, T. Xing, M. Yang, J. Tong, and Q. Zhang, "Time-series anomaly detection service at microsoft," in Proceedings of the 25th ACM SIGKDD international conference on knowledge discovery & data mining, 2019, pp. 3009- 3017.
  40. J. Soldani and A. Brogi, "Anomaly detection and failure root cause analysis in (micro) service-based cloud applications: A survey," ACM Comput. Surv., vol. 55, no. 3, pp. 59:1-59:39, 2023. [Online]. Available: https://doi.org/10.1145/3501297 · DOI · Paper page
  41. Z. Z. Darban, G. I. Webb, S. Pan, C. C. Aggarwal, and M. Salehi, "Deep learning for time series anomaly detection: A survey," CoRR, vol. abs/2211.05244, 2022. [Online]. Available: https://doi.org/10.48550/arXiv.2211.05244 · DOI
  42. B. Huang, K. Zhang, M. Gong, and C. Glymour, "Causal discovery and forecasting in nonstationary environments with state-space models," in Proceedings of the 36th International Conference on Machine Learning, ICML 2019, 9-15 June 2019, Long Beach, California, USA, ser. Proceedings of Machine Learning Research, K. Chaudhuri and R. Salakhutdinov, Eds., vol. 97. PMLR, 2019, pp. 2901-2910. [Online]. Available: http://proceedings.mlr.press/v97/huang19g.html
  43. Q. Pham, C. Liu, D. Sahoo, and S. C. H. Hoi, "Learning fast and slow for online time series forecasting," CoRR, vol. abs/2202.11672, 2022. [Online]. Available: https://arxiv.org/abs/2202.11672 · arXiv
  44. K. Lai, D. Zha, J. Xu, Y. Zhao, G. Wang, and X. Hu, "Revisiting time series outlier detection: Definitions and benchmarks," in Proceedings of the Neural Information Processing Systems Track on Datasets and Benchmarks 1, NeurIPS Datasets and Benchmarks 2021, December 2021, virtual, J. Vanschoren and S. Yeung, Eds., 2021. [Online]. Available: https://datasets-benchmarks-proceedings.neurips.cc/paper/ 2021/hash/ec5decca5ed3d6b8079e2e7e7bacc9f2-Abstract-round1.html
  45. R. Wu and E. Keogh, "Current time series anomaly detection bench- marks are flawed and are creating the illusion of progress," IEEE Transactions on Knowledge and Data Engineering, 2021.
  46. D. Sahoo, Q. Pham, J. Lu, and S. C. H. Hoi, "Online deep learning: Learning deep neural networks on the fly," CoRR, vol. abs/1711.03705, 2017. [Online]. Available: http://arxiv.org/abs/1711.03705 · arXiv
  47. Z. Chen, J. Liu, W. Gu, Y. Su, and M. R. Lyu, "Experience report: Deep learning-based system log analysis for anomaly detection," 2021. [Online]. Available: https://arxiv.org/abs/2107.05908 · arXiv
  48. P. He, J. Zhu, Z. Zheng, and M. R. Lyu, "Drain: An online log parsing approach with fixed depth tree," in 2017 IEEE International Conference on Web Services (ICWS), 2017, pp. 33-40.
  49. Z. M. Jiang, A. E. Hassan, P. Flora, and G. Hamann, "Abstracting execution logs to execution events for enterprise applications (short paper)," in 2008 The Eighth International Conference on Quality Software, 2008, pp. 181-186.
  50. M. Du and F. Li, "Spell: Streaming parsing of system event logs," in 2016 IEEE 16th International Conference on Data Mining (ICDM), 2016, pp. 859-864.
  51. Q. Fu, J.-G. Lou, Y. Wang, and J. Li, "Execution anomaly detection in distributed systems through unstructured log analysis," in 2009 Ninth IEEE International Conference on Data Mining, 2009, pp. 149-158.
  52. M. Mizutani, "Incremental mining of system log format," in 2013 IEEE International Conference on Services Computing, 2013, pp. 595-602.
  53. K. Shima, "Length matters: Clustering system log messages using length of words," CoRR, vol. abs/1611.03213, 2016. [Online]. Available: http://arxiv.org/abs/1611.03213 · arXiv
  54. R. Vaarandi, "A data clustering algorithm for mining patterns from event logs," in Proceedings of the 3rd IEEE Workshop on IP Operations & Management (IPOM 2003) (IEEE Cat. No.03EX764), 2003, pp. 119- 126.
  55. M. Nagappan and M. A. Vouk, "Abstracting log lines to log event types for mining software system logs," in 2010 7th IEEE Working Conference on Mining Software Repositories (MSR 2010), 2010, pp. 114-117.
  56. S. Nedelkoski, J. Bogatinovski, A. Acker, J. Cardoso, and O. Kao, "Self-supervised log parsing," in Machine Learning and Knowledge Discovery in Databases: Applied Data Science Track, Y. Dong, D. Mladenić, and C. Saunders, Eds. Cham: Springer International Publishing, 2021, pp. 122-138.
  57. V.-H. Le and H. Zhang, "Log-based anomaly detection without log parsing," in 2021 36th IEEE/ACM International Conference on Auto- mated Software Engineering (ASE), 2021, pp. 492-504.
  58. Y. Lee, J. Kim, and P. Kang, "Lanobert : System log anomaly detection based on BERT masked language model," CoRR, vol. abs/2111.09564, 2021. [Online]. Available: https://arxiv.org/abs/2111.09564 · arXiv
  59. M. Farshchi, J.-G. Schneider, I. Weber, and J. Grundy, "Experience report: Anomaly detection of cloud application operations using log and cloud metric correlation analysis," in 2015 IEEE 26th International Symposium on Software Reliability Engineering (ISSRE), 2015, pp. 24- 34.
  60. W. Meng, Y. Liu, Y. Zhu, S. Zhang, D. Pei, Y. Liu, Y. Chen, R. Zhang, S. Tao, P. Sun, and R. Zhou, "Loganomaly: Unsupervised detection of sequential and quantitative anomalies in unstructured logs," in Proceedings of the 28th International Joint Conference on Artificial Intelligence, ser. IJCAI'19. AAAI Press, 2019, p. 4739-4745.
  61. B. Joshi, U. Bista, and M. Ghimire, "Intelligent clustering scheme for log data streams," in Computational Linguistics and Intelligent Text Processing, A. Gelbukh, Ed. Berlin, Heidelberg: Springer Berlin Heidelberg, 2014, pp. 454-465.
  62. D. Gunter, B. L. Tierney, A. Brown, M. Swany, J. Bresnahan, and J. M. Schopf, "Log summarization and anomaly detection for troubleshooting distributed systems," in 2007 8th IEEE/ACM International Conference on Grid Computing, 2007, pp. 226-234.
  63. W. Meng, F. Zaiter, Y. Huang, Y. Liu, S. Zhang, Y. Zhang, Y. Zhu, T. Zhang, E. Wang, Z. Ren, F. Wang, S. Tao, and D. Pei, "Summarizing unstructured logs in online services," CoRR, vol. abs/2012.08938, 2020. [Online]. Available: https://arxiv.org/abs/2012.08938 · arXiv
  64. R. Dijkman and A. Wilbik, "Linguistic summarization of event logs -a practical approach," Information Systems, vol. 67, pp. 114-125, 2017. [Online]. Available: https://www.sciencedirect.com/ science/article/pii/S0306437916303192
  65. S. Locke, H. Li, T.-H. P. Chen, W. Shang, and W. Liu, "Logassist: Assisting log analysis through log summarization," IEEE Transactions on Software Engineering, pp. 1-1, 2021.
  66. Y. Liang, Y. Zhang, H. Xiong, and R. Sahoo, "Failure prediction in ibm bluegene/l event logs," in Seventh IEEE International Conference on Data Mining (ICDM 2007), 2007, pp. 583-588.
  67. M. Chen, A. Zheng, J. Lloyd, M. Jordan, and E. Brewer, "Failure diag- nosis using decision trees," in International Conference on Autonomic Computing, 2004. Proceedings., 2004, pp. 36-43.
  68. J. Lou, Q. Fu, S. Yang, Y. Xu, and J. Li, "Mining invariants from console logs for system problem detection," in 2010 USENIX Annual Technical Conference, Boston, MA, USA, June 23-25, 2010, P. Barham and T. Roscoe, Eds. USENIX Association, 2010. [Online]. Available: https://www.usenix.org/conference/usenix-atc-10/ mining-invariants-console-logs-system-problem-detection
  69. T. Jia, P. Chen, L. Yang, Y. Li, F. Meng, and J. Xu, "An approach for anomaly diagnosis based on hybrid graph model with logs for distributed services," in 2017 IEEE International Conference on Web Services (ICWS), 2017, pp. 25-32.
  70. T. Jia, L. Yang, P. Chen, Y. Li, F. Meng, and J. Xu, "Logsed: Anomaly diagnosis through mining time-weighted control flow graph in logs," in 2017 IEEE 10th International Conference on Cloud Computing (CLOUD), 2017, pp. 447-455.
  71. W. Meng, Y. Liu, Y. Huang, S. Zhang, F. Zaiter, B. Chen, and D. Pei, "A semantic-aware representation framework for online log analysis," in 2020 29th International Conference on Computer Communications and Networks (ICCCN), 2020, pp. 1-7.
  72. A. Farzad and T. A. Gulliver, "Unsupervised log message anomaly detection," ICT Express, vol. 6, no. 3, pp. 229-237, 2020. [Online]. Available: https://www.sciencedirect.com/science/article/pii/ S2405959520300643
  73. S. Nedelkoski, J. Bogatinovski, A. Acker, J. Cardoso, and O. Kao, "Self-attentive classification-based anomaly detection in unstructured logs," in 2020 IEEE International Conference on Data Mining (ICDM), 2020, pp. 1196-1201.
  74. L. Yang, J. Chen, Z. Wang, W. Wang, J. Jiang, X. Dong, and W. Zhang, "Semi-supervised log-based anomaly detection via probabilistic label estimation," in 2021 IEEE/ACM 43rd International Conference on Software Engineering (ICSE), 2021, pp. 1448-1460.
  75. H. Guo, S. Yuan, and X. Wu, "Logbert: Log anomaly detection via bert," in 2021 International Joint Conference on Neural Networks (IJCNN), 2021, pp. 1-8.
  76. Z. Zhao, W. Niu, X. Zhang, R. Zhang, Z. Yu, and C. Huang, "Trine: Syslog anomaly detection with three transformer encoders in one generative adversarial network," Applied Intelligence, vol. 52, no. 8, p. 8810-8819, jun 2022. [Online]. Available: https://doi.org/10.1007/ s10489-021-02863-9 · DOI
  77. R. Chen, S. Zhang, D. Li, Y. Zhang, F. Guo, W. Meng, D. Pei, Y. Zhang, X. Chen, and Y. Liu, "Logtransfer: Cross-system log anomaly detection for software systems with transfer learning," in 2020 IEEE 31st International Symposium on Software Reliability Engineering (ISSRE), 2020, pp. 37-47.
  78. X. Li, P. Chen, L. Jing, Z. He, and G. Yu, "Swisslog: Robust and unified deep learning based log anomaly detection for diverse faults," in 2020 IEEE 31st International Symposium on Software Reliability Engineering (ISSRE), 2020, pp. 92-103.
  79. Y. Xie, H. Zhang, and M. A. Babar, "Loggd:detecting anomalies from system logs by graph neural networks," 2022. [Online]. Available: https://arxiv.org/abs/2209.07869 · arXiv
  80. Y. Wan, Y. Liu, D. Wang, and Y. Wen, "Glad-paw: Graph-based log anomaly detection by position aware weighted graph attention network," in Advances in Knowledge Discovery and Data Mining, K. Karlapalem, H. Cheng, N. Ramakrishnan, R. K. Agrawal, P. K. Reddy, J. Srivastava, and T. Chakraborty, Eds. Cham: Springer International Publishing, 2021, pp. 66-77.
  81. S. Huang, Y. Liu, C. Fung, R. He, Y. Zhao, H. Yang, and Z. Luan, "Hi- tanomaly: Hierarchical transformers for anomaly detection in system log," IEEE Transactions on Network and Service Management, vol. 17, no. 4, pp. 2064-2076, 2020.
  82. H. Cheng, D. Xu, S. Yuan, and X. Wu, "Fine-grained anomaly detection in sequential data via counterfactual explanations," 2022. [Online]. Available: https://arxiv.org/abs/2210.04145 · arXiv
  83. S. Nedelkoski, J. Cardoso, and O. Kao, "Anomaly detection from system tracing data using multimodal deep learning," in 2019 IEEE 12th International Conference on Cloud Computing (CLOUD), 2019, pp. 179-186.
  84. C. Zhang, X. Peng, C. Sha, K. Zhang, Z. Fu, X. Wu, Q. Lin, and D. Zhang, "Deeptralog: Trace-log combined microservice anomaly detection through graph-based deep learning." Pittsburgh, PA, USA: IEEE, 2022, pp. 623-634.
  85. D. C. Arnold, D. H. Ahn, B. R. De Supinski, G. L. Lee, B. P. Miller, and M. Schulz, "Stack trace analysis for large scale debugging," in 2007 IEEE International Parallel and Distributed Processing Symposium. IEEE, 2007, pp. 1-10.
  86. Z. Cai, W. Li, W. Zhu, L. Liu, and B. Yang, "A real-time trace- level root-cause diagnosis system in alibaba datacenters," IEEE Access, vol. 7, pp. 142 692-142 702, 2019.
  87. P. Papadimitriou, A. Dasdan, and H. Garcia-Molina, "Web graph similarity for anomaly detection," Journal of Internet Services and Applications, vol. 1, no. 1, pp. 19-30, 2010.
  88. M. Y. Chen, E. Kiciman, E. Fratkin, A. Fox, and E. Brewer, "Pinpoint: Problem determination in large, dynamic internet services," in Proceed- ings International Conference on Dependable Systems and Networks. IEEE, 2002, pp. 595-604.
  89. S. Hochreiter and J. Schmidhuber, "Long short-term memory," Neural Computation, vol. 9, no. 8, pp. 1735-1780, 1997.
  90. E. Pinheiro, W. Weber, and L. A. Barroso, "Failure trends in a large disk drive population," in 5th USENIX Conference on File and Storage Technologies, FAST 2007, February 13-16, 2007, San Jose, CA, USA, A. C. Arpaci-Dusseau and R. H. Arpaci- Dusseau, Eds. USENIX, 2007, pp. 17-28. [Online]. Available: http://www.usenix.org/events/fast07/tech/pinheiro.html
  91. Y. Xu, K. Sui, R. Yao, H. Zhang, Q. Lin, Y. Dang, P. Li, K. Jiang, W. Zhang, J. Lou, M. Chintalapati, and D. Zhang, "Improving service availability of cloud systems by predicting disk error," in 2018 USENIX Annual Technical Conference, USENIX ATC 2018, Boston, MA, USA, July 11-13, 2018, H. S. Gunawi and B. Reed, Eds. USENIX Association, 2018, pp. 481-494. [Online]. Available: https://www.usenix.org/conference/atc18/presentation/xu-yong
  92. F. Yu, H. Xu, S. Jian, C. Huang, Y. Wang, and Z. Wu, "Dram failure prediction in large-scale data centers," in 2021 IEEE International Conference on Joint Cloud Computing (JCC), 2021, pp. 1-8.
  93. J. Klinkenberg, C. Terboven, S. Lankes, and M. S. Müller, "Data mining-based analysis of hpc center operations," in 2017 IEEE In- ternational Conference on Cluster Computing (CLUSTER), 2017, pp. 766-773.
  94. S. Zhang, Y. Liu, W. Meng, Z. Luo, J. Bu, S. Yang, P. Liang, D. Pei, J. Xu, Y. Zhang, Y. Chen, H. Dong, X. Qu, and L. Song, "Prefix: Switch failure prediction in datacenter networks," Proc. ACM Meas. Anal. Comput. Syst., vol. 2, no. 1, apr 2018. [Online]. Available: https://doi.org/10.1145/3179405 · DOI
  95. F. Salfner and M. Malek, "Using hidden semi-markov models for effective online failure prediction," in 2007 26th IEEE International Symposium on Reliable Distributed Systems (SRDS 2007), 2007, pp. 161-174.
  96. J. Gao, H. Wang, and H. Shen, "Task failure prediction in cloud data centers using deep learning," in 2019 IEEE International Conference on Big Data (Big Data), 2019, pp. 1111-1116.
  97. Z. Zheng, Z. Lan, B. H. Park, and A. Geist, "System log pre-processing to improve failure prediction," in 2009 IEEE/IFIP International Con- ference on Dependable Systems and Networks, 2009, pp. 572-577.
  98. Y. Chen, X. Yang, Q. Lin, H. Zhang, F. Gao, Z. Xu, Y. Dang, D. Zhang, H. Dong, Y. Xu, H. Li, and Y. Kang, "Outage prediction and diagnosis for cloud service systems," in The World Wide Web Conference, ser. WWW '19. New York, NY, USA: Association for Computing Machinery, 2019, p. 2659-2665. [Online]. Available: https://doi.org/10.1145/3308558.3313501 · DOI
  99. Q. Lin, K. Hsieh, Y. Dang, H. Zhang, K. Sui, Y. Xu, J.-G. Lou, C. Li, Y. Wu, R. Yao, M. Chintalapati, and D. Zhang, "Predicting node failure in cloud service systems," in Proceedings of the 2018 26th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering, ser. ESEC/FSE 2018. New York, NY, USA: Association for Computing Machinery, 2018, p. 480-490. [Online]. Available: https://doi.org/10.1145/3236024.3236060 · DOI
  100. H. Nguyen, Z. Shen, Y. Tan, and X. Gu, "Fchain: Toward black- box online fault localization for cloud systems," in 2013 IEEE 33rd International Conference on Distributed Computing Systems, 2013, pp. 21-30.
  101. L. Wu, J. Tordsson, E. Elmroth, and O. Kao, "Microrca: Root cause localization of performance issues in microservices," in NOMS 2020 -2020 IEEE/IFIP Network Operations and Management Symposium, 2020, pp. 1-9.
  102. Álvaro Brandón, M. Solé, A. Huélamo, D. Solans, M. S. Pérez, and V. Muntés-Mulero, "Graph-based root cause analysis for service-oriented and microservice architectures," Journal of Systems and Software, vol. 159, p. 110432, 2020. [Online]. Available: https://www.sciencedirect.com/science/article/pii/S0164121219302067
  103. A. Samir and C. Pahl, "Dla: Detecting and localizing anomalies in containerized microservice architectures using markov models," in 2019 7th International Conference on Future Internet of Things and Cloud (FiCloud), 2019, pp. 205-213.
  104. P. Wang, J. Xu, M. Ma, W. Lin, D. Pan, Y. Wang, and P. Chen, "Cloudranger: Root cause identification for cloud native systems," in 2018 18th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (CCGRID), 2018, pp. 492-502.
  105. L. Mariani, C. Monni, M. Pezzé, O. Riganelli, and R. Xin, "Localizing faults in cloud systems," in 2018 IEEE 11th International Conference on Software Testing, Verification and Validation (ICST), 2018, pp. 262- 273.
  106. P. Chen, Y. Qi, and D. Hou, "Causeinfer: Automated end-to-end performance diagnosis with hierarchical causality graph in cloud envi- ronment," IEEE Transactions on Services Computing, vol. 12, no. 2, pp. 214-230, 2019.
  107. Y. Meng, S. Zhang, Y. Sun, R. Zhang, Z. Hu, Y. Zhang, C. Jia, Z. Wang, and D. Pei, "Localizing failure root causes in a microservice through causality inference," in 2020 IEEE/ACM 28th International Symposium on Quality of Service (IWQoS), 2020, pp. 1-10.
  108. M. Ma, W. Lin, D. Pan, and P. Wang, "Ms-rank: Multi-metric and self-adaptive root cause diagnosis for microservice applications," in 2019 IEEE International Conference on Web Services (ICWS), 2019, pp. 60-67.
  109. P. Spirtes and C. Glymour, "An algorithm for fast recovery of sparse causal graphs," Social Science Computer Review, vol. 9, no. 1, pp. 62-72, 1991.
  110. D. M. Chickering, "Learning equivalence classes of Bayesian-network structures," J. Mach. Learn. Res., vol. 2, no. 3, pp. 445-498, 2002.
  111. --, "Optimal structure identification with greedy search," J. Mach. Learn. Res., vol. 3, no. 3, pp. 507-554, 2003.
  112. J. Runge, "Discovering contemporaneous and lagged causal relations in autocorrelated nonlinear time series datasets," in UAI, 2020.
  113. A. Gerhardus and J. Runge, "High-recall causal discovery for autocorrelated time series with latent confounders," in Advances in Neural Information Processing Systems, H. Larochelle, M. Ranzato, R. Hadsell, M. Balcan, and H. Lin, Eds., vol. 33. Curran Associates, Inc., 2020, pp. 12 615-12 625. [Online]. Available: https://proceedings.neurips.cc/paper/2020/file/ 94e70705efae423efda1088614128d0b-Paper.pdf
  114. J. Qiu, Q. Du, K. Yin, S.-L. Zhang, and C. Qian, "A causality mining and knowledge graph based method of root cause diagnosis for performance anomaly in cloud applications," Applied Sciences, vol. 10, no. 6, 2020. [Online]. Available: https://www.mdpi.com/ 2076-3417/10/6/2166
  115. K. Budhathoki, L. Minorics, P. Bloebaum, and D. Janzing, "Causal structure-based root cause analysis of outliers," in ICML 2022, 2022. [Online]. Available: https://www.amazon.science/publications/ causal-structure-based-root-cause-analysis-of-outliers
  116. S. Lu, B. Rao, X. Wei, B. Tak, L. Wang, and L. Wang, "Log-based abnormal task detection and root cause analysis for spark," in 2017 IEEE International Conference on Web Services (ICWS), 2017, pp. 389-396.
  117. L. Wang, N. Zhao, J. Chen, P. Li, W. Zhang, and K. Sui, "Root-cause metric location for microservice systems via log anomaly detection," in 2020 IEEE International Conference on Web Services (ICWS), 2020, pp. 142-150.
  118. E. Chuah, S.-h. Kuo, P. Hiew, W.-C. Tjhi, G. Lee, J. Hammond, M. T. Michalewicz, T. Hung, and J. C. Browne, "Diagnosing the root-causes of failures from cluster log files," in 2010 International Conference on High Performance Computing, 2010, pp. 1-10.
  119. T. S. Zaman, X. Han, and T. Yu, "Scminer: Localizing system- level concurrency faults from large system call traces," in 2019 34th IEEE/ACM International Conference on Automated Software Engineer- ing (ASE), 2019, pp. 515-526.
  120. K. Zhang, J. Xu, M. R. Min, G. Jiang, K. Pelechrinis, and H. Zhang, "Automated it system failure prediction: A deep learning approach," in 2016 IEEE International Conference on Big Data (Big Data), 2016, pp. 1291-1300.
  121. Y. Yuan, W. Shi, B. Liang, and B. Qin, "An approach to cloud execution failure diagnosis based on exception logs in openstack," in 2019 IEEE 12th International Conference on Cloud Computing (CLOUD), 2019, pp. 124-131.
  122. H. Mi, H. Wang, Y. Zhou, M. R.-T. Lyu, and H. Cai, "Toward fine- grained, unsupervised, scalable performance diagnosis for production cloud computing systems," IEEE Transactions on Parallel and Dis- tributed Systems, vol. 24, no. 6, pp. 1245-1255, 2013.
  123. A. Amar and P. C. Rigby, "Mining historical test logs to predict bugs and localize faults in the test logs," in 2019 IEEE/ACM 41st International Conference on Software Engineering (ICSE), 2019, pp. 140-151.
  124. A. Ekelhart, F. J. Ekaputra, and E. Kiesling, "The slogert framework for automated log knowledge graph construction," in The Semantic Web, R. Verborgh, K. Hose, H. Paulheim, P.-A. Champin, M. Maleshkova, O. Corcho, P. Ristoski, and M. Alam, Eds. Cham: Springer Interna- tional Publishing, 2021, pp. 631-646.
  125. B. C. Tak, S. Tao, L. Yang, C. Zhu, and Y. Ruan, "Logan: Problem diagnosis in the cloud using log-based reference models," in 2016 IEEE International Conference on Cloud Engineering (IC2E), 2016, pp. 62- 67.
  126. W. Shang, Z. M. Jiang, H. Hemmati, B. Adams, A. E. Hassan, and P. Martin, "Assisting developers of big data analytics applications when deploying on hadoop clouds," in 2013 35th International Conference on Software Engineering (ICSE), 2013, pp. 402-411.
  127. C. Pham, L. Wang, B. C. Tak, S. Baset, C. Tang, Z. Kalbarczyk, and R. K. Iyer, "Failure diagnosis for distributed systems using targeted fault injection," IEEE Transactions on Parallel and Distributed Sys- tems, vol. 28, no. 2, pp. 503-516, 2017.
  128. K. Nagaraj, C. Killian, and J. Neville, "Structured comparative analysis of systems logs to diagnose performance problems," in Proceedings of the 9th USENIX Conference on Networked Systems Design and Implementation, ser. NSDI'12. USA: USENIX Association, 2012, p. 26.
  129. H. Ikeuchi, A. Watanabe, T. Kawata, and R. Kawahara, "Root-cause diagnosis using logs generated by user actions," in 2018 IEEE Global Communications Conference (GLOBECOM), 2018, pp. 1-7.
  130. P. Aggarwal, A. Gupta, P. Mohapatra, S. Nagar, A. Mandal, Q. Wang, and A. Paradkar, "Localization of operational faults in cloud appli- cations by mining causal dependencies in logs using golden signals," in Service-Oriented Computing -ICSOC 2020 Workshops, H. Hacid, F. Outay, H.-y. Paik, A. Alloum, M. Petrocchi, M. R. Bouadjenek, A. Beheshti, X. Liu, and A. Maaradji, Eds. Cham: Springer Interna- tional Publishing, 2021, pp. 137-149.
  131. X. Fu, R. Ren, S. A. McKee, J. Zhan, and N. Sun, "Digging deeper into cluster system logs for failure prediction and root cause diagno- sis," in 2014 IEEE International Conference on Cluster Computing (CLUSTER), 2014, pp. 103-112.
  132. S. Kobayashi, K. Fukuda, and H. Esaki, "Mining causes of network events in log data with causal inference," in 2017 IFIP/IEEE Sympo- sium on Integrated Network and Service Management (IM), 2017, pp. 45-53.
  133. S. Kobayashi, K. Otomo, and K. Fukuda, "Causal analysis of network logs with layered protocols and topology knowledge," in 2019 15th In- ternational Conference on Network and Service Management (CNSM), 2019, pp. 1-9.
  134. R. Jarry, S. Kobayashi, and K. Fukuda, "A quantitative causal analysis for network log data," in 2021 IEEE 45th Annual Computers, Software, and Applications Conference (COMPSAC), 2021, pp. 1437-1442.
  135. Z. Li, J. Chen, R. Jiao, N. Zhao, Z. Wang, S. Zhang, Y. Wu, L. Jiang, L. Yan, Z. Wang et al., "Practical root cause localization for microservice systems via trace analysis," in 2021 IEEE/ACM 29th International Symposium on Quality of Service (IWQOS). IEEE, 2021, pp. 1-10.
  136. X. Zhou, X. Peng, T. Xie, J. Sun, C. Ji, D. Liu, Q. Xiang, and C. He, "Latent error prediction and fault localization for microservice applications by learning from system trace logs," in Proceedings of the 2019 27th ACM Joint Meeting on European Software Engineering Con- ference and Symposium on the Foundations of Software Engineering, 2019, pp. 683-694.
  137. P. Liu, H. Xu, Q. Ouyang, R. Jiao, Z. Chen, S. Zhang, J. Yang, L. Mo, J. Zeng, W. Xue et al., "Unsupervised detection of microservice trace anomalies through service-level deep bayesian networks," in 2020 IEEE 31st International Symposium on Software Reliability Engineering (ISSRE). IEEE, 2020, pp. 48-58.
  138. M. Shetty, C. Bansal, S. P. Upadhyayula, A. Radhakrishna, and A. Gupta, "Autotsg: Learning and synthesis for incident troubleshooting," CoRR, vol. abs/2205.13457, 2022. [Online]. Available: https://doi.org/10.48550/arXiv.2205.13457 · DOI
  139. X. Nie, Y. Zhao, K. Sui, D. Pei, Y. Chen, and X. Qu, "Mining causality graph for automatic web-based service diagnosis," in 2016 IEEE 35th International Performance Computing and Communications Conference (IPCCC), 2016, pp. 1-8.
  140. W. Lin, M. Ma, D. Pan, and P. Wang, "Facgraph: Frequent anomaly correlation graph mining for root cause diagnose in micro-service architecture," in 2018 IEEE 37th International Performance Computing and Communications Conference (IPCCC), 2018, pp. 1-8.
  141. R. Ding, Q. Fu, J. G. Lou, Q. Lin, D. Zhang, and T. Xie, "Mining his- torical issue repositories to heal large-scale online service systems," in 2014 44th Annual IEEE/IFIP International Conference on Dependable Systems and Networks, 2014, pp. 311-322.
  142. A. Saha and S. C. H. Hoi, "Mining root cause knowledge from cloud service incident investigations for aiops," in 44th IEEE/ACM International Conference on Software Engineering: Software Engineering in Practice, ICSE (SEIP) 2022, Pittsburgh, PA, USA, May 22-24, 2022. IEEE, 2022, pp. 197-206. [Online]. Available: https://doi.org/10.1109/ICSE-SEIP55303.2022.9793994 · DOI
  143. S. Becker, F. Schmidt, A. Gulenko, A. Acker, and O. Kao, "Towards aiops in edge computing environments," in 2020 IEEE International Conference on Big Data (Big Data), 2020, pp. 3470-3475.
  144. S. Levy, R. Yao, Y. Wu, Y. Dang, P. Huang, Z. Mu, P. Zhao, T. Ramani, N. Govindaraju, X. Li, Q. Lin, G. L. Shafriri, and M. Chintalapati, "Predictive and adaptive failure mitigation to avert production cloud VM interruptions," in 14th USENIX Symposium on Operating Systems Design and Implementation (OSDI 20). USENIX Association, Nov. 2020, pp. 1155-1170. [Online]. Available: https://www.usenix.org/conference/osdi20/presentation/levy
  145. J. D. Hamilton, Time Series Analysis. Princeton University Press, 1994.
  146. S. Hochreiter and J. Schmidhuber, "Long short-term memory," Neural Computation, vol. 9, no. 8, pp. 1735-1780, 1997.
  147. R. N. Calheiros, E. Masoumi, R. Ranjan, and R. Buyya, "Workload prediction using arima model and its impact on cloud applications' qos," IEEE Transactions on Cloud Computing, vol. 3, no. 4, pp. 449- 458, 2015.
  148. D. Buchaca, J. L. Berral, C. Wang, and A. Youssef, "Proactive container auto-scaling for cloud native machine learning services," in 2020 IEEE 13th International Conference on Cloud Computing (CLOUD), 2020, pp. 475-479.
  149. M. Wajahat, A. Gandhi, A. Karve, and A. Kochut, "Using machine learning for black-box autoscaling," in 2016 Seventh International Green and Sustainable Computing Conference (IGSC), 2016, pp. 1- 8.
  150. N.-M. Dang-Quang and M. Yoo, "Deep learning-based autoscaling using bidirectional long short-term memory for kubernetes," Applied Sciences, vol. 11, no. 9, 2021. [Online]. Available: https://www.mdpi. com/2076-3417/11/9/3835
  151. Y. Garí, D. A. Monge, E. Pacini, C. Mateos, and C. García Garino, "Reinforcement learning-based application autoscaling in the cloud: A survey," Engineering Applications of Artificial Intelligence, vol. 102, p. 104288, 2021. [Online]. Available: https://www.sciencedirect.com/ science/article/pii/S0952197621001354
  152. S. Mustafa, B. Nazir, A. Hayat, A. ur Rehman Khan, and S. A. Madani, "Resource management in cloud computing: Taxonomy, prospects, and challenges," Computers and Electrical Engineering, vol. 47, pp. 186-203, 2015. [Online]. Available: https://www.sciencedirect.com/ science/article/pii/S004579061500275X
  153. T. Khan, W. Tian, G. Zhou, S. Ilager, M. Gong, and R. Buyya, "Machine learning (ml)-centric resource management in cloud computing: A review and future directions," Journal of Network and Computer Applications, vol. 204, p. 103405, 2022. [Online]. Available: https://www.sciencedirect.com/science/article/pii/S1084804522000649
  154. F. Nzanywayingoma and Y. Yang, "Efficient resource management techniques in cloud computing environment: a review and discussion," International Journal of Computers and Applications, vol. 41, no. 3, pp. 165-182, 2019. [Online]. Available: https://doi.org/10.1080/ 1206212X.2017.1416558 · DOI
  155. N. M. Gonzalez, T. C. M. D. B. Carvalho, and C. C. Miers, "Cloud resource management: Towards efficient execution of large-scale scientific applications and workflows on complex infrastructures," J. Cloud Comput., vol. 6, no. 1, dec 2017. [Online]. Available: https://doi.org/10.1186/s13677-017-0081-4 · DOI
  156. S. Ilager, K. Ramamohanarao, and R. Buyya, "Thermal prediction for efficient energy management of clouds using machine learning," IEEE Transactions on Parallel and Distributed Systems, vol. 32, no. 5, pp. 1044-1056, 2021.
  157. Y. Guo, Y. Wen, C. Jiang, Y. Lian, and Y. Wan, "Detecting log anomalies with multi-head attention (LAMA)," CoRR, vol. abs/2101.02392, 2021. [Online]. Available: https://arxiv.org/abs/2101. 02392 · arXiv
  158. C. Zhang, X. Wang, H. Zhang, H. Zhang, and P. Han, "Log sequence anomaly detection based on local information extraction and globally sparse transformer model," IEEE Transactions on Network and Service Management, vol. 18, no. 4, pp. 4119-4133, 2021.
  159. Q. Wang, X. Zhang, X. Wang, and Z. Cao, "Log Sequence Anomaly Detection Method Based on Contrastive Adversarial Training and Dual Feature Extraction," Entropy, vol. 24, no. 1, p. 69, Dec. 2021.
  160. M. Attariyan, M. Chow, and J. Flinn, "X-ray: Automating {Root- Cause} diagnosis of performance anomalies in production software," in 10th USENIX Symposium on Operating Systems Design and Imple- mentation (OSDI 12), 2012, pp. 307-320.
  161. X. Guo, X. Peng, H. Wang, W. Li, H. Jiang, D. Ding, T. Xie, and L. Su, "Graph-based trace analysis for microservice architecture understanding and problem diagnosis," in Proceedings of the 28th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering, 2020, pp. 1387-1397.
  162. Y. Xu, Y. Zhu, B. Qiao, H. Che, P. Zhao, X. Zhang, Z. Li, Y. Dang, and Q. Lin, "Tracelingo: Trace representation and learning for performance issue diagnosis in cloud services," in 2021 IEEE/ACM International Workshop on Cloud Intelligence (CloudIntelligence). IEEE, 2021, pp. 37-40.

Cited by

Sorted by citations

Related

Authors
Cheng, Q., Sahoo, D., Saha, A., Yang, W., Liu, C., Woo, G., Singh, M., Saverese, S., & Hoi, S. C. H.
ORCID
Venue
arXiv
Publisher
arXiv
Published
2023
ISSN
2331-8422 (ISSN-L)
DOI
10.48550/arxiv.2304.04661
arXiv
2304.04661
OpenAlex
W4364387555
Cited by
23
References
0
Citations by year
2026: 1 · 2025: 7 · 2024: 9 · 2023: 6
Type
posted content
Language
en
Open access
Licence
Locations
  • arXiv (Cornell University) (submittedVersion, cc-by)
  • arXiv (Cornell University) (cc-by)
Topics
  • Physical Sciences › Computer Science › Computer Networks and Communications › Software System Performance and Reliability
  • Physical Sciences › Computer Science › Information Systems › Cloud Computing and Resource Management
  • Physical Sciences › Computer Science › Information Systems › Software Engineering Research
Keywords
AIOps, IT operations, cloud infrastructure, incident detection, failure prediction, root cause analysis, big data analytics, system availability

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review