The DOI matches its Crossref record; 142 of the 142 references it cites were found in a registry or an index.
A Survey of AIOps Methods for Failure Management
Abstract
Modern society is increasingly moving toward complex and distributed computing systems. The increase in scale and complexity of these systems challenges O&M teams that perform daily monitoring and repair operations, in contrast with the increasing demand for reliability and scalability of modern applications. For this reason, the study of automated and intelligent monitoring systems has recently sparked much interest across applied IT industry and academia. Artificial Intelligence for IT Operations (AIOps) has been proposed to tackle modern IT administration challenges thanks to Machine Learning, AI, and Big Data. However, AIOps as a research topic is still largely unstructured and unexplored, due to missing conventions in categorizing contributions for their data requirements, target goals, and components. In this work, we focus on AIOps for Failure Management (FM), characterizing and describing 5 different categories and 14 subcategories of contributions, based on their time intervention window and the target problem being solved. We review 100 FM solutions, focusing on applicability requirements and the quantitative results achieved, to facilitate an effective application of AIOps solutions. Finally, we discuss current development problems in the areas covered by AIOps and delineate possible future trends for AI-based failure management.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“This boundary matters because security and governance depend on the tools an agent can invoke, the permissions attached to those tools, and the checks enforced before action [18], [8], [10].”
From Large language models for agentic NetOps and AIOps: Architectures, evaluation, and safety (2027) · cites this paper as [18]
In the citing paper
“Compared with NetOps, AIOps produces a broader and more detailed set of narrative artefacts [18], [55].”
From Large language models for agentic NetOps and AIOps: Architectures, evaluation, and safety (2027) · cites this paper as [18]
In the citing paper
“However, the true operational benefits lie in the actual mitigation of incidents [18], [55].”
From Large language models for agentic NetOps and AIOps: Architectures, evaluation, and safety (2027) · cites this paper as [18]
In the citing paper
“Agentic operations systems inevitably consume and produce artefacts [55], [18].”
From Large language models for agentic NetOps and AIOps: Architectures, evaluation, and safety (2027) · cites this paper as [18]
In the citing paper
“Advancement in the field has been limited by the reliance on proprietary incident corpora, heterogeneous telemetry infrastructures, and insufficiently robust ground truth [135], [18].”
From Large language models for agentic NetOps and AIOps: Architectures, evaluation, and safety (2027) · cites this paper as [18]
Citations
Cites
Chandola, V., Banerjee, A., & Kumar, V. (2009) · ACM Computing Surveys · doi:10.1145/1541880.1541882 · Cited by 11,687
McCabe, T. J. (1976) · IEEE Transactions on Software Engineering · doi:10.1109/tse.1976.233837 · Cited by 6,059
A metrics suite for object oriented design
Chidamber, S. R., & Kemerer, C. F. (1994) · IEEE Transactions on Software Engineering · doi:10.1109/32.295895 · Cited by 5,669
Gao, Z., Cecati, C., & Ding, S. X. (2015) · IEEE Transactions on Industrial Electronics · doi:10.1109/tie.2015.2417501 · Cited by 3,135
DeepLog: Anomaly Detection and Diagnosis from System Logs through Deep Learning
Du, M., Li, F., Zheng, G., & Srikumar, V. (2017) · Proceedings of the 2017 ACM SIGSAC Conference on Computer and Communications Security · doi:10.1145/3133956.3134015 · Cited by 1,835
Robust Anomaly Detection for Multivariate Time Series through Stochastic Recurrent Neural Network
Su, Y., Zhao, Y., Niu, C., Liu, R., Sun, W., & Pei, D. (2019) · Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining · doi:10.1145/3292500.3330672 · Cited by 1,804
A survey of techniques for internet traffic classification using machine learning
Nguyen, T. T. T., & Armitage, G. (2008) · IEEE Communications Surveys & Tutorials · doi:10.1109/surv.2008.080406 · Cited by 1,664
Detecting large-scale system problems by mining console logs
Xu, W., Huang, L., Fox, A., Patterson, D., & Jordan, M. I. (2009) · Proceedings of the ACM SIGOPS 22nd symposium on Operating systems principles · doi:10.1145/1629575.1629587 · Cited by 1,332
Deep Learning for Anomaly Detection: A Survey
Chalapathy, R., & Chawla, S. (2019) · arXiv · doi:10.48550/arxiv.1901.03407 · Cited by 1,240
Data Mining Static Code Attributes to Learn Defect Predictors
Menzies, T., Greenwald, J., & Frank, A. (2007) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2007.256941 · Cited by 1,215
Internet traffic classification using bayesian analysis techniques
Moore, A. W., & Zuev, D. (2005) · Proceedings of the 2005 ACM SIGMETRICS international conference on Measurement and modeling of computer systems · doi:10.1145/1064212.1064220 · Cited by 1,208
A Survey on Software Fault Localization
Wong, W. E., Gao, R., Li, Y., Abreu, R., & Wotawa, F. (2016) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2016.2521368 · Cited by 1,110
USAD: UnSupervised Anomaly Detection on Multivariate Time Series
Audibert, J., Michiardi, P., Guyard, F., Marti, S., & Zuluaga, M. A. (2020) · Proceedings of the 26th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining · doi:10.1145/3394486.3403392 · Cited by 1,094
End-to-end encrypted traffic classification with one-dimensional convolution neural networks
Wang, W., Zhu, M., Wang, J., Zeng, X., & Yang, Z. (2017) · 2017 IEEE International Conference on Intelligence and Security Informatics (ISI) · doi:10.1109/isi.2017.8004872 · Cited by 991
Software rejuvenation: analysis, module and applications
Huang, Y., Kintala, C., Kolettis, N., & Fulton, N. D. (2002) · Twenty-Fifth International Symposium on Fault-Tolerant Computing. Digest of Papers · doi:10.1109/ftcs.1995.466961 · Cited by 926
Long Short-Term Memory Network for Remaining Useful Life estimation
Zheng, S., Ristovski, K., Farahat, A., & Gupta, C. (2017) · 2017 IEEE International Conference on Prognostics and Health Management (ICPHM) · doi:10.1109/icphm.2017.7998311 · Cited by 882
Zhang, C., Song, D., Chen, Y., Feng, X., Lumezanu, C., Cheng, W., Ni, J., Zong, B., Chen, H., & Chawla, N. V. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33011409 · Cited by 855
Pinpoint: problem determination in large, dynamic Internet services
Chen, M. Y., Kiciman, E., Fratkin, E., Fox, A., & Brewer, E. (2003) · Proceedings International Conference on Dependable Systems and Networks · doi:10.1109/dsn.2002.1029005 · Cited by 835
A unified framework for coupling measurement in object-oriented systems
Briand, L. C., Daly, J. W., & Wust, J. K. (1999) · IEEE Transactions on Software Engineering · doi:10.1109/32.748920 · Cited by 814
Unsupervised Anomaly Detection via Variational Auto-Encoder for Seasonal KPIs in Web Applications
Xu, H., Feng, Y., Chen, J., Wang, Z., Qiao, H., Chen, W., Zhao, N., Li, Z., Bu, J., Li, Z., et al. (2018) · Proceedings of the 2018 World Wide Web Conference on World Wide Web - WWW '18 · doi:10.1145/3178876.3185996 · Cited by 808
Mining metrics to predict component failures
Nagappan, N., Ball, T., & Zeller, A. (2006) · Proceedings of the 28th international conference on Software engineering · doi:10.1145/1134285.1134349 · Cited by 782
Experiments on the effectiveness of dataflow- and control-flow-based test adequacy criteria
Hutchins, M., Foster, H. D., Goradia, T., & Ostrand, T. J. (1994) · doi:10.5555/257734.257766 · Cited by 774
Robust log-based anomaly detection on unstable log data
Zhang, X., Xu, Y., Lin, Q., Qiao, B., Zhang, H., Dang, Y., Xie, C., Yang, X., Cheng, Q., Li, Z., et al. (2019) · Proceedings of the 2019 27th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering · doi:10.1145/3338906.3338931 · Cited by 761
Predicting fault incidence using software change history
Graves, T. L., Karr, A. F., Marron, J. S., & Siy, H. (2000) · IEEE Transactions on Software Engineering · doi:10.1109/32.859533 · Cited by 753
Predicting the location and number of faults in large software systems
Ostrand, T. J., Weyuker, E. J., & Bell, R. M. (2005) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2005.49 · Cited by 720
A survey of combinatorial testing
Nie, C., & Leung, H. (2011) · ACM Computing Surveys · doi:10.1145/1883612.1883618 · Cited by 714
Moser, R., Pedrycz, W., & Succi, G. (2008) · Proceedings of the 13th international conference on Software engineering - ICSE '08 · doi:10.1145/1368088.1368114 · Cited by 701
Automatically learning semantic features for defect prediction
Wang, S., Liu, T., & Tan, L. (2016) · Proceedings of the 38th International Conference on Software Engineering · doi:10.1145/2884781.2884804 · Cited by 689
Rahbar, A. G. P., & Yang, O. W. W. (2008) · IEEE Communications Surveys & Tutorials · doi:10.1109/surv.2008.080408 · Cited by 668
Evaluating defect prediction approaches: a benchmark and an extensive comparison
D’Ambros, M., Lanza, M., & Robbes, R. (2012) · Empirical Software Engineering · doi:10.1007/s10664-011-9173-9 · Cited by 626
Fault Localization with Nearest Neighbor Queries
Renieris, M., & Reiss, S. P. (2003) · Cited by 582
Fault injection for dependability validation: a methodology and some applications
Arlat, J., Aguera, M., Amat, L., Crouzet, Y., Fabre, J.-C., Laprie, J.-C., Martins, E., & Powell, D. (1990) · IEEE Transactions on Software Engineering · doi:10.1109/32.44380 · Cited by 570
A survey of online failure prediction methods
Salfner, F., Lenk, M., & Malek, M. (2010) · ACM Computing Surveys · doi:10.1145/1670679.1670680 · Cited by 560
Performance debugging for distributed systems of black boxes
Aguilera, M. K., Mogul, J. C., Wiener, J. L., Reynolds, P., & Muthitacharoen, A. (2003) · ACM SIGOPS Operating Systems Review · doi:10.1145/1165389.945454 · Cited by 558
Locating causes of program failures
Cleve, H., & Zeller, A. (2005) · Proceedings of the 27th international conference on Software engineering - ICSE '05 · doi:10.1145/1062455.1062522 · Cited by 550
Execution Anomaly Detection in Distributed Systems through Unstructured Log Analysis
Fu, Q., Lou, J.-G., Wang, Y., & Li, J. (2009) · 2009 Ninth IEEE International Conference on Data Mining · doi:10.1109/icdm.2009.60 · Cited by 542
Isolating cause-effect chains from computer programs
Zeller, A. (2002) · Proceedings of the 10th ACM SIGSOFT symposium on Foundations of software engineering · doi:10.1145/587051.587053 · Cited by 530
Predicting defect-prone software modules using support vector machines
Elish, K. O., & Elish, M. O. (2008) · Journal of Systems and Software · doi:10.1016/j.jss.2007.07.040 · Cited by 525
Design, Modeling, and Evaluation of a Scalable Multi-level Checkpointing System
Moody, A., Bronevetsky, G., Mohror, K., & Supinski, B. R. D. (2010) · 2010 ACM/IEEE International Conference for High Performance Computing, Networking, Storage and Analysis · doi:10.1109/sc.2010.18 · Cited by 521
Characterizing cloud computing hardware reliability
Vishwanath, K. V., & Nagappan, N. (2010) · Proceedings of the 1st ACM symposium on Cloud computing · doi:10.1145/1807128.1807161 · Cited by 509
Bayesian Neural Networks for Internet Traffic Classification
Auld, T., Moore, A. W., & Gull, S. F. (2007) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2006.883010 · Cited by 494
The DStar Method for Effective Software Fault Localization
Wong, W. E., Debroy, V., Gao, R., & Li, Y. (2014) · IEEE Transactions on Reliability · doi:10.1109/tr.2013.2285319 · Cited by 479
Software Defect Prediction via Convolutional Neural Network
Li, J., He, P., Zhu, J., & Lyu, M. R. (2017) · 2017 IEEE International Conference on Software Quality, Reliability and Security (QRS) · doi:10.1109/qrs.2017.42 · Cited by 462
Internet traffic classification using bayesian analysis techniques
Moore, A. W., & Zuev, D. (2005) · ACM SIGMETRICS Performance Evaluation Review · doi:10.1145/1071690.1064220 · Cited by 460
Mining anomalies using traffic feature distributions
Lakhina, A., Crovella, M., & Diot, C. (2005) · ACM SIGCOMM Computer Communication Review · doi:10.1145/1090191.1080118 · Cited by 446
Log clustering based problem identification for online service systems
Lin, Q., Zhang, H., Lou, J.-G., Zhang, Y., & Chen, X. (2016) · Proceedings of the 38th International Conference on Software Engineering Companion · doi:10.1145/2889160.2889232 · Cited by 427
Diagnosing network-wide traffic anomalies
Lakhina, A., Crovella, M., & Diot, C. (2004) · ACM SIGCOMM Computer Communication Review · doi:10.1145/1030194.1015492 · Cited by 419
ReLink: recovering links between bugs and changes
Wu, R., Zhang, H., Kim, S., & Cheung, S.-C. (2011) · Proceedings of the 19th ACM SIGSOFT symposium and the 13th European conference on Foundations of software engineering · doi:10.1145/2025113.2025120 · Cited by 412
Spectrum-Based Multiple Fault Localization
Abreu, R., Zoeteweij, P., & van Gemund, A. J. C. (2009) · 2009 IEEE/ACM International Conference on Automated Software Engineering · doi:10.1109/ase.2009.25 · Cited by 401
Performance debugging for distributed systems of black boxes
Aguilera, M. K., Mogul, J. C., Wiener, J. L., Reynolds, P., & Muthitacharoen, A. (2003) · Proceedings of the nineteenth ACM symposium on Operating systems principles · doi:10.1145/945445.945454 · Cited by 334
Software defect prediction using Bayesian networks
Okutan, A., & Yıldız, O. T. (2014) · Empirical Software Engineering · doi:10.1007/s10664-012-9218-8 · Cited by 330
Automated support for classifying software failure reports
Podgurski, A., Leon, D., Francis, P., Masri, W., & Minch, M. (2003) · Cited by 314
Proactive management of software aging
Castelli, V., Harper, R. E., Heidelberger, P., Hunter, S. W., Trivedi, K. S., Vaidyanathan, K., & Zeggert, W. P. (2001) · IBM Journal of Research and Development · doi:10.1147/rd.452.0311 · Cited by 303
Failure Prediction in IBM BlueGene/L Event Logs
Liang, Y., Zhang, Y., Xiong, H., & Sahoo, R. (2007) · Seventh IEEE International Conference on Data Mining (ICDM 2007) · doi:10.1109/icdm.2007.46 · Cited by 292
Nam, J., Pan, S. J., & Kim, S. (2014) · Cited by 282
Support Vector Machines for TCP traffic classification
Este, A., Gringoli, F., & Salgarelli, L. (2009) · Computer Networks · doi:10.1016/j.comnet.2009.05.003 · Cited by 270
A Comprehensive Model for Software Rejuvenation
Vaidyanathan, K., & Trivedi, K. S. (2005) · IEEE Transactions on Dependable and Secure Computing · doi:10.1109/tdsc.2005.15 · Cited by 259
Machine Learning Methods for Predicting Failures in Hard Drives: A Multiple-Instance Application
Murray, J. F., Hughes, G. F., & Kreutz-Delgado, K. (2005) · doi:10.5555/1046920.1088699 · Cited by 259
Opprentice: Towards Practical and Automatic Anomaly Detection Through Machine Learning
Liu, D., Zhao, Y., Xu, H., Sun, Y., Pei, D., Luo, J., Jing, X., & Feng, M. (2015) · Proceedings of the 2015 Internet Measurement Conference · doi:10.1145/2815675.2815679 · Cited by 252
Fingerprinting the datacenter: automated classification of performance crises
Bodik, P., Goldszmidt, M., Fox, A., Woodard, D. B., & Andersen, H. (2010) · Proceedings of the 5th European conference on Computer systems · doi:10.1145/1755913.1755926 · Cited by 250
DOCTOR: an integrated software fault injection environment for distributed real-time systems
Han, S., Shin, K. G., & Rosenberg, H. A. (2002) · Proceedings of 1995 IEEE International Computer Performance and Dependability Symposium · doi:10.1109/ipds.1995.395831 · Cited by 242
AIOps: Real-World Challenges and Research Innovations
Dang, Y., Lin, Q., & Huang, P. (2019) · 2019 IEEE/ACM 41st International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1109/icse-companion.2019.00023 · Cited by 238
Prediction of software reliability using connectionist models
Karunanithi, N., Whitley, D., & Malaiya, Y. K. (1992) · IEEE Transactions on Software Engineering · doi:10.1109/32.148475 · Cited by 225
Improved disk-drive failure warnings
Hughes, G. F., Murray, J. F., Kreutz-Delgado, K., & Elkan, C. (2002) · IEEE Transactions on Reliability · doi:10.1109/tr.2002.802886 · Cited by 216
Analysis of software rejuvenation using Markov Regenerative Stochastic Petri Net
Garg, S., Puliafito, A., Telek, M., & Trivedi, K. S. (2002) · Proceedings of Sixth International Symposium on Software Reliability Engineering. ISSRE'95 · doi:10.1109/issre.1995.497656 · Cited by 215
SherLog: error diagnosis by connecting clues from run-time logs
Yuan, D., Mai, H., Xiong, W., Tan, L., Zhou, Y., & Pasupathy, S. (2010) · ACM SIGARCH Computer Architecture News · doi:10.1145/1735970.1736038 · Cited by 212
Learning to Log: Helping Developers Make Informed Logging Decisions
Zhu, J., He, P., Fu, Q., Zhang, H., Lyu, M. R., & Zhang, D. (2015) · 2015 IEEE/ACM 37th IEEE International Conference on Software Engineering · doi:10.1109/icse.2015.60 · Cited by 212
On Fault Representativeness of Software Fault Injection
Natella, R., Cotroneo, D., Duraes, J. A., & Madeira, H. S. (2013) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2011.124 · Cited by 199
Recurrent Neural Network Attention Mechanisms for Interpretable System Log Anomaly Detection
Brown, A., Tuor, A., Hutchinson, B., & Nichols, N. (2018) · Proceedings of the First Workshop on Machine Learning for Computing Systems · doi:10.1145/3217871.3217872 · Cited by 198
Shrink: a tool for failure diagnosis in IP networks
Kandula, S., Katabi, D., & Vasseur, J.-P. (2005) · Proceeding of the 2005 ACM SIGCOMM workshop on Mining network data - MineNet '05 · doi:10.1145/1080173.1080178 · Cited by 197
Toward Comprehensible Software Fault Prediction Models Using Bayesian Network Classifiers
Dejaeger, K., Verbraken, T., & Baesens, B. (2013) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2012.20 · Cited by 190
Assessing Dependability with Software Fault Injection: A Survey
Natella, R., Cotroneo, D., & Madeira, H. S. (2016) · ACM Computing Surveys · doi:10.1145/2841425 · Cited by 188
Alarm correlation and fault identification in communication networks
Bouloutas, A. T., Calo, S., & Finkel, A. (1994) · IEEE Transactions on Communications · doi:10.1109/tcomm.1994.577079 · Cited by 187
X-ray: automating root-cause diagnosis of performance anomalies in production software
Attariyan, M., Chow, M., & Flinn, J. (2012) · doi:10.5555/2387880.2387910 · Cited by 184
Inferring models of concurrent systems from logs of their behavior with CSight
Beschastnikh, I., Brun, Y., Ernst, M. D., & Krishnamurthy, A. (2014) · Proceedings of the 36th International Conference on Software Engineering · doi:10.1145/2568225.2568246 · Cited by 181
Classification of software behaviors for failure detection: a discriminative pattern mining approach
Lo, D., Cheng, H., Han, J., Khoo, S.-C., & Sun, C. (2009) · Proceedings of the 15th ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/1557019.1557083 · Cited by 180
Sufficient mutation operators for measuring test effectiveness
Siami Namin, A., Andrews, J. H., & Murdoch, D. J. (2008) · Proceedings of the 13th international conference on Software engineering - ICSE '08 · doi:10.1145/1368088.1368136 · Cited by 178
SherLog: error diagnosis by connecting clues from run-time logs
Yuan, D., Mai, H., Xiong, W., Tan, L., Zhou, Y., & Pasupathy, S. (2010) · Proceedings of the fifteenth International Conference on Architectural support for programming languages and operating systems · doi:10.1145/1736020.1736038 · Cited by 176
Performance Anomaly Detection and Bottleneck Identification
Ibidunmoye, O., Hernández-Rodriguez, F., & Elmroth, E. (2015) · ACM Computing Surveys · doi:10.1145/2791120 · Cited by 173
Automated IT system failure prediction: A deep learning approach
Zhang, K., Xu, J., Min, M. R., Jiang, G., Pelechrinis, K., & Zhang, H. (2016) · 2016 IEEE International Conference on Big Data (Big Data) · doi:10.1109/bigdata.2016.7840733 · Cited by 171
The mystery machine: end-to-end performance analysis of large-scale internet services
Chow, M., Meisner, D., Flinn, J., Peek, D., & Wenisch, T. F. (2014) · Operating Systems Design and Implementation · doi:10.5555/2685048.2685066 · Cited by 166
Health Status Assessment and Failure Prediction for Hard Drives with Recurrent Neural Networks
Xu, C., Wang, G., Liu, X., Guo, D., & Liu, T.-Y. (2016) · IEEE Transactions on Computers · doi:10.1109/tc.2016.2538237 · Cited by 165
Giger, E., D'Ambros, M., Pinzger, M., & Gall, H. C. (2012) · Proceedings of the ACM-IEEE international symposium on Empirical software engineering and measurement · doi:10.1145/2372251.2372285 · Cited by 164
Capturing, indexing, clustering, and retrieving system history
Cohen, I., Zhang, S., Goldszmidt, M., Symons, J., Kelly, T., & Fox, A. (2005) · Proceedings of the twentieth ACM symposium on Operating systems principles · doi:10.1145/1095810.1095821 · Cited by 161
A Learning-to-Rank Approach to Software Defect Prediction
Yang, X., Tang, K., & Yao, X. (2014) · IEEE Transactions on Reliability · doi:10.1109/tr.2014.2370891 · Cited by 159
Hard Drive Failure Prediction Using Classification and Regression Trees
Li, J., Ji, X., Jia, Y., Zhu, B., Wang, G., Li, Z., & Liu, X. (2014) · International Conference on Dependable Systems & Networks/Proceedings · doi:10.1109/dsn.2014.44 · Cited by 152
Failure prediction based on log files using Random Indexing and Support Vector Machines
Fronza, I., Sillitti, A., Succi, G., Terho, M., & Vlasenko, J. (2012) · Journal of Systems and Software · doi:10.1016/j.jss.2012.06.025 · Cited by 148
Be conservative: enhancing failure diagnosis with proactive logging
Yuan, D., Park, S., Huang, P., Liu, Y., Lee, M. M., Tang, X., Zhou, Y., & Savage, S. (2013) · Cited by 143
Khoshgoftaar, T. M., & Lanning, D. L. (1995) · Journal of Systems and Software · doi:10.1016/0164-1212(94)00130-f · Cited by 137
Proactive drive failure prediction for large scale storage systems
Zhu, B., Wang, G., Liu, X., Hu, D., Lin, S., & Ma, J. (2013) · Digest of papers - IEEE Symposium on Mass Storage Systems · doi:10.1109/msst.2013.6558427 · Cited by 137
Cloudsim: simulator for cloud computing infrastructure and modeling
Goyal, T., Singh, A. P., & Agrawal, A. (2012) · Procedia Engineering · doi:10.1016/j.proeng.2012.06.412 · Cited by 135
Anomaly Detection and Classification using Distributed Tracing and Deep Learning
Nedelkoski, S., Cardoso, J., & Kao, O. (2019) · IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (CCGrid) · doi:10.1109/ccgrid.2019.00038 · Cited by 133
Self-citationSSD Failures in Datacenters: What? When? and Why?
Narayanan, I., Wang, D., Jeon, M., Sharma, B., Caulfield, L., Sivasubramaniam, A., Cutler, B., Liu, J., Khessib, B., & Vaid, K. (2016) · ACM International Systems and Storage Conference (SYSTOR) · doi:10.1145/2928275.2928278 · Cited by 126
Towards highly reliable enterprise network services via inference of multi-level dependencies
Bahl, P., Chandra, R., Greenberg, A. G., Kandula, S., Maltz, D. A., & Zhang, M. (2007) · ACM SIGCOMM Computer Communication Review · doi:10.1145/1282427.1282383 · Cited by 124
Disk Failure Prediction in Data Centers via Online Learning
Xiao, J., Xiong, Z., Wu, S., Yi, Y., Jin, H., & Hu, K. (2018) · Proceedings of the International Conference on Parallel Processing · doi:10.1145/3225058.3225106 · Cited by 122
Toward a Smart Cloud: A Review of Fault-Tolerance Methods in Cloud Systems
Mukwevho, A. M., & Çelik, T. (2018) · IEEE Transactions on Services Computing · doi:10.1109/tsc.2018.2816644 · Cited by 119
Liu, C., Yan, X., Long, F., Han, J., & Midkiff, S. P. (2005) · ACM SIGSOFT Software Engineering Notes · doi:10.1145/1095430.1081753 · Cited by 117
Fault Detection and Diagnosis in Distributed Systems: An Approach by Partially Stochastic Petri Nets
Aghasaryan, A., Fabre, É., Albert Benveniste, A., Boubour, R., & Jard, C. (1998) · Discrete Event Dynamic Systems · doi:10.1023/a:1008241818642 · Cited by 115
Zhao, X., Rodrigues, K., Luo, Y., Stumm, M., Yuan, D., & Zhou, Y. (2017) · ACM SIGOPS Symposium on Operating Systems Principles (SOSP) · doi:10.1145/3132747.3132778 · Cited by 113
Online Anomaly Detection for Hard Disk Drives Based on Mahalanobis Distance
Wang, Y., Miao, Q., Ma, E. W. M., Tsui, K., & PECHT, M. G. (2013) · IEEE Transactions on Reliability · doi:10.1109/tr.2013.2241204 · Cited by 110
Predicting Node Failures in an Ultra-Large-Scale Cloud Computing Platform: An AIOps Solution
Li, Y., Jiang, Z. M., Li, H., Hassan, A. E., He, C., Huang, R., Zeng, Z., Wang, M., & Chen, P. (2020) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3385187 · Cited by 108
Syslog processing for switch failure diagnosis and prediction in datacenter networks
Zhang, S., Meng, W., Bu, J., Yang, S., Liu, Y., Pei, D., Xu, J. J., Chen, Y., Dong, H. F., Qu, X., et al. (2017) · International Workshop on Quality of Service · doi:10.1109/iwqos.2017.7969130 · Cited by 99
FChain: Toward Black-Box Online Fault Localization for Cloud Systems
Nguyen, H., Shen, Z., Tan, Y., & Gu, X. (2013) · IEEE International Conference on Distributed Computing Systems (ICDCS) · doi:10.1109/icdcs.2013.26 · Cited by 96
Failure Analysis of Jobs in Compute Clouds: A Google Cluster Case Study
Chen, X., Lu, C., & Pattabiraman, K. (2014) · IEEE International Symposium on Software Reliability Engineering (ISSRE) · doi:10.1109/issre.2014.34 · Cited by 94
Hora: Architecture-aware online failure prediction
Pitakrat, T., Okanović, D., van Hoorn, A., & Grunske, L. (2017) · Journal of Systems and Software · doi:10.1016/j.jss.2017.02.041 · Cited by 91
Meiliana, M., Karim, S., Warnars, H. L. H. S., Gaol, F. L., Abdurachman, E., & Soewito, B. (2017) · IEEE International Conference on Cybernetics and Computational Intelligence (CyberneticsCom) · doi:10.1109/cyberneticscom.2017.8311708 · Cited by 87
Predicting Disk Failures with HMM- and HSMM-Based Approaches
Zhao, Y., Liu, X., Gan, S., & Zheng, W. (2010) · Lecture notes in computer science · doi:10.1007/978-3-642-14400-4_30 · Cited by 86
Adaptive on-line software aging prediction based on machine learning
Alonso, J., Torres, J., Berral, J. L., & Gavaldà, R. (2010) · International Conference on Dependable Systems & Networks/Proceedings · doi:10.1109/dsn.2010.5544275 · Cited by 84
CloudPD: Problem determination and diagnosis in shared dynamic clouds
Sharma, B., Jayachandran, P., Verma, A., & Das, C. R. (2013) · International Conference on Dependable Systems & Networks/Proceedings · doi:10.1109/dsn.2013.6575298 · Cited by 81
AI and OR in management of operations: history and trends
Kobbacy, K. A. H., Vadera, S., & Rasmy, M. H. (2006) · Journal of the Operational Research Society · doi:10.1057/palgrave.jors.2602132 · Cited by 80
Efficient ticket routing by resolution sequence mining
Shao, Q., Chen, Y., Tao, S., Yan, X., & Anerousis, N. (2008) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/1401890.1401964 · Cited by 76
Survey on Models and Techniques for Root-Cause Analysis
Solé, M., Muntés-Mulero, V., Rana, A. I., & Estrada, G. (2017) · arXiv · doi:10.48550/arxiv.1701.08546 · Cited by 74
HotSpot: Anomaly Localization for Additive KPIs With Multi-Dimensional Attributes
Sun, Y., Zhao, Y., Su, Y., Liu, D., Nie, X., Meng, Y., Cheng, S., Pei, D., Zhang, S., Qu, X., et al. (2018) · IEEE Access · doi:10.1109/access.2018.2804764 · Cited by 73
Dependability measurement and modeling of a multicomputer system
Tang, D., & Iyer, R. K. (1993) · IEEE Transactions on Computers · doi:10.1109/12.192214 · Cited by 70
An approach to predictive detection for service management
Hellerstein, J. L., Zhang, F., & Shahabuddin, P. (2003) · doi:10.1109/inm.1999.770691 · Cited by 70
Predicting Application Failure in Cloud: A Machine Learning Approach
Islam, T., & Manivannan, D. (2017) · IEEE International Conference on Cognitive Computing (ICCC) · doi:10.1109/ieee.iccc.2017.11 · Cited by 70
RAIDShield: Characterizing, Monitoring, and Proactively Protecting Against Disk Failures
Ma, A., Douglis, F., Lu, G., Sawyer, D., Emc Corporation, Douglis, F., Lu, G., Ch, S., & Hsu, W. (2015) · Cited by 69
DeCaf: diagnosing and triaging performance issues in large-scale cloud services
Bansal, C., Renganathan, S., Asudani, A., Midy, O., & Janakiraman, M. (2020) · IEEE/ACM International Conference on Software Engineering: Software Engineering in Practice (ICSE-SEIP) · doi:10.1145/3377813.3381353 · Cited by 66
Structure and chance: melding logic and probability for software debugging
Burnell, L. J., & Horvitz, E. (1995) · Communications of the ACM · doi:10.1145/203330.203338 · Cited by 52
Being Accurate Is Not Enough: New Metrics for Disk Failure Prediction
Li, J., Stones, R. J., Wang, G., Li, Z., Liu, X., & Xiao, K. (2016) · IEEE Symposium on Reliable Distributed Systems (SRDS) · doi:10.1109/srds.2016.019 · Cited by 51
Failure Prediction of Data Centers Using Time Series and Fault Tree Analysis
Chalermarrewong, T., Achalakul, T., & See, S. C. W. (2012) · IEEE International Conference on Parallel and Distributed Systems (ICPADS) · doi:10.1109/icpads.2012.129 · Cited by 49
Bayes predictive analysis of a fundamental software reliability model
Csenki, A. (1990) · IEEE Transactions on Reliability · doi:10.1109/24.55879 · Cited by 49
Generic and Robust Localization of Multi-dimensional Root Causes
Li, Z., Luo, C., Zhao, Y., Sun, Y., Sui, K., Wang, X., Liu, D., Jin, X., Wang, Q., & Pei, D. (2019) · Proceedings/Proceedings - International Symposium on Software Reliability Engineering · doi:10.1109/issre.2019.00015 · Cited by 47
Knowledge Guided Hierarchical Multi-Label Classification Over Ticket Data
Zeng, C., Zhou, W., Li, T., Shwartz, L., & Grabarnik, G. Y. (2017) · IEEE Transactions on Network and Service Management · doi:10.1109/tnsm.2017.2668363 · Cited by 44
Internet service performance failure detection
Ward, A. R., Glynn, P. W., & Richardson, K. J. (1998) · ACM SIGMETRICS Performance Evaluation Review · doi:10.1145/306225.306237 · Cited by 43
Jangjaimon, I., & Tzeng, N.-F. (2014) · IEEE Transactions on Computers · doi:10.1109/tc.2013.225 · Cited by 43
A survey of AI in operations management from 2005 to 2009
Kobbacy, K. A. H., & Vadera, S. (2011) · Journal of Manufacturing Technology Management · doi:10.1108/17410381111149602 · Cited by 42
Fast Dimensional Analysis for Root Cause Investigation in a Large-Scale Service Environment
Lin, F., Muzumdar, K., Laptev, N., Curelea, M.-V., Lee, S., & Sankar, S. (2020) · Proceedings of the ACM on Measurement and Analysis of Computing Systems · doi:10.1145/3392149 · Cited by 41
A System Software Approach to Proactive Memory-Error Avoidance
Costa, C. H. Ã., Park, Y., Rosenburg, B. S., Cher, C.-Y., & Ryu, K. D. (2014) · International Conference for High Performance Computing, Networking, Storage and Analysis (SC) · doi:10.1109/sc.2014.63 · Cited by 39
Jauk, D., Yang, D. L., & Schulz, M. (2019) · International Conference for High Performance Computing, Networking, Storage and Analysis (SC) · doi:10.1145/3295500.3356185 · Cited by 36
Resolution recommendation for event tickets in service management
Zhou, W., Tang, L., Li, T., Shwartz, L., & Grabarnik, G. Y. (2015) · IFIP/IEEE International Symposium on Integrated Network Management (IM) · doi:10.1109/inm.2015.7140303 · Cited by 33
FTAPE - A fault injection tool to measure fault tolerance
Tsai, T. K., & Iyer, R. K. (1995) · AIAA Computing in Aerospace Conference · doi:10.2514/6.1995-1041 · Cited by 28
HVS-based Imperceptibility Measure of Watermark in Watermarked Color Image
Yang, H.-M., Liang, Y., Liu, L., & Sun, H. (2007) · ACIS International Conference on Software Engineering, Artificial Intelligence, Networking and Parallel/Distributed Computing (SNPD) · doi:10.1109/snpd.2007.106 · Cited by 28
AIOps for a Cloud Object Storage Service
Levin, A., Garion, S., Kolodner, E. K., Lorenz, D. H., Barabash, K., Kugler, M., & McShane, N. (2019) · IEEE International Congress on Big Data (BigData Congress) · doi:10.1109/bigdatacongress.2019.00036 · Cited by 28
Lin, F., Beadon, M., Dixit, H. D., Vunnam, G., Desai, A., & Sankar, S. (2018) · International Conference on Dependable Systems and Networks workshops · doi:10.1109/dsn-w.2018.00015 · Cited by 26
Constructing the Knowledge Base for Cognitive IT Service Management
Wang, Q., Zhou, W., Zeng, C., Li, T., Shwartz, L., & Grabarnik, G. Y. (2017) · IEEE International Conference on Services Computing · doi:10.1109/scc.2017.59 · Cited by 24
Network anomaly detection: A survey and comparative analysis of stochastic and deterministic methods
Wang, J., Rossell, D., Cassandras, C. G., & Paschalidis, I. C. (2013) · IEEE Conference on Decision and Control (CDC) · doi:10.1109/cdc.2013.6759879 · Cited by 22
FailureSim: A System for Predicting Hardware Failures in Cloud Data Centers Using Neural Networks
Davis, N., Rezgui, A., Soliman, H., Manzanares, S., & Coates, M. (2017) · IEEE ... International Conference on Cloud Computing · doi:10.1109/cloud.2017.75 · Cited by 14
Data Mining Static Code Attributes to Learn Defect Predictors
MenziesTim, GreenwaldJeremy, & FrankArt (2007) · IEEE Transactions on Software Engineering · doi:10.5555/1248721.1248734 · Cited by 12
A Systematic Mapping Study on Fault Management in Cloud Computing
Neto, C. B. L., Filho, P. C., & Duarte, A. N. (2013) · International Conference on Parallel and Distributed Computing, Applications and Technologies (PDCAT) · doi:10.1109/pdcat.2013.59 · Cited by 11
Intelligence and Security Informatics
Chen, H., Chau, M., & Wang, G. A. (2017) · Lecture notes in computer science · doi:10.1007/978-3-319-57463-9 · Cited by 11
A neural net based approach for fault diagnosis in distribution networks
Butler, K. L., & Momoh, J. A. (1999) · IEEE Power Engineering Society Winter Meeting · doi:10.1109/pesw.1999.747478 · Cited by 8
Research works printed but not linked: 29
- 10.5555/1251054.1251069 · doi:10.5555/1251054.1251069
- 10.5555/647883.738238 · doi:10.5555/647883.738238
- 10.5555/1251175.1251198 · doi:10.5555/1251175.1251198
- 10.5555/1251254.1251270 · doi:10.5555/1251254.1251270
- B. Dhanalaxmi, G. Apparao Naidu, and K. Anuradha. 2015. A review on software fault detection and prevention mechanism in software development activities. J. Comput. Eng. 17, 6 (2015), 25–30.
- 10.5555/822084.823242 · doi:10.5555/822084.823242
- 10.1109/TIE.2015.2417501 · DOI · Paper page
- 10.5555/851015.856162 · doi:10.5555/851015.856162
- 10.5555/540137 · doi:10.5555/540137
- 10.5555/645530.655825 · doi:10.5555/645530.655825
- 10.5555/876900.881183 · doi:10.5555/876900.881183
- 10.5555/874064.875631 · doi:10.5555/874064.875631
- 10.5555/2227057.2227061 · doi:10.5555/2227057.2227061
- 10.5555/280136.280168 · doi:10.5555/280136.280168
- 10.5555/2750482.2750501 · doi:10.5555/2750482.2750501
- 10.5555/3154690.3154728 · doi:10.5555/3154690.3154728
- 10.5555/3367471.3367702 · doi:10.5555/3367471.3367702
- 10.5555/2486788.2486839 · doi:10.5555/2486788.2486839
- 10.5555/2478566.2479080 · doi:10.5555/2478566.2479080
- Paolo Notaro, Jorge Cardoso, and Michael Gerndt. 2020. A systematic mapping study in AIOps. In Proceedings of the International Conference on Service-oriented Computing (ICSOC’20). Workshops: AIOps, CFTIC, STRAPS, AI-PA, AI-IOTS, and Satellite Events. Springer, 110–123. Retrieved from http://arxiv.org/abs/2012.09108. · arXiv
- 10.5555/977407.978751 · doi:10.5555/977407.978751
- 10.5555/1267903.1267905 · doi:10.5555/1267903.1267905
- 10.5555/776816.776872 · doi:10.5555/776816.776872
- 10.5555/3106091.3106097 · doi:10.5555/3106091.3106097
- 10.5555/1308172.1308231 · doi:10.5555/1308172.1308231
- Mark Schwabacher and Kai Goebel. 2007. A survey of artificial intelligence for prognostics. In Proceedings of the AAAI Fall Symposium on Artificial Intelligence for Prognostics. AAAI, 108–115. Retrieved from https://www.aaai.org/Library/Symposia/Fall/2007/fs07-02-016.php.
- 10.5555/851020.856189 · doi:10.5555/851020.856189
- 10.5555/2387880.2387909 · doi:10.5555/2387880.2387909
- 10.5555/1880672.1880707 · doi:10.5555/1880672.1880707
Cited by
Artificial intelligence-driven real-world battery diagnostics
Zhao, J., Qu, X., Wu, Y., Fowler, M. W., & Burke, A. F. (2024) · Energy and AI · doi:10.1016/j.egyai.2024.100419 · Cited by 114
Causal Inference-Based Root Cause Analysis for Online Service Systems with Intervention Recognition
Li, M., Li, Z., Yin, K., Nie, X., Zhang, W., Sui, K., & Pei, D. (2022) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3534678.3539041 · Cited by 141
A Joint Study of the Challenges, Opportunities, and Roadmap of MLOps and AIOps: A Systematic Survey
Díaz-de-Arcaya, J., Torre-Bastida, A. I., Zárate, G., Miñón, R., & Almeida, A. (2023) · ACM Computing Surveys · doi:10.1145/3625289 · Cited by 161
Failure Diagnosis in Microservice Systems: A Comprehensive Survey and Analysis
Zhang, S., Xia, S., Fan, W., Shi, B., Xiong, X., Zhong, Z., Ma, M., Sun, Y., & Pei, D. (2026) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3715005 · Cited by 57
Zhang, C., Hu, D., & Yang, T. (2023) · Reliability Engineering & System Safety · doi:10.1016/j.ress.2023.109634 · Cited by 58
Metadata
- Authors
- Notaro, P., Cardoso, J., & Gerndt, M.
- Affiliations
- Technical University of Munich (DE)
- University of Coimbra (PT)
- Venue
- ACM Transactions on Intelligent Systems and Technology
- Published
- 2021-11-30
- Volume
- 12
- Issue
- 6
- Pages
- 1-45
- ISSN
- 2157-6904 (ISSN-L)
- 2157-6912
- OpenAlex
- W3217360625
- Cited by
- 142
- References
- 140
- Citations by year
- 2026: 53 · 2025: 34 · 2024: 28 · 2023: 19 · 2022: 7
- FWCI
- 6.04
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- ACM Transactions on Intelligent Systems and Technology (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Computer Networks and Communications › Software System Performance and Reliability
- Physical Sciences › Computer Science › Information Systems › Cloud Computing and Resource Management
- Physical Sciences › Computer Science › Computer Networks and Communications › Distributed systems and fault tolerance
- Keywords
- AIOps, failure management, IT operations, automated monitoring, fault diagnosis, distributed systems
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.