Predicting Node Failures in an Ultra-Large-Scale Cloud Computing Platform: An AIOps Solution
The DOI matches its Crossref record; 7 of the 7 references it cites were found in a registry or an index.
Abstract
Many software services today are hosted on cloud computing platforms, such as Amazon EC2, due to many benefits like reduced operational costs. However, node failures in these platforms can impact the availability of their hosted services and potentially lead to large financial losses. Predicting node failures before they actually occur is crucial, as it enables DevOps engineers to minimize their impact by performing preventative actions. However, such predictions are hard due to many challenges like the enormous size of the monitoring data and the complexity of the failure symptoms. AIOps ( A rtificial I ntelligence for IT Op eration s ), a recently introduced approach in DevOps, leverages data analytics and machine learning to improve the quality of computing platforms in a cost-effective manner. However, the successful adoption of such AIOps solutions requires much more than a top-performing machine learning model. Instead, AIOps solutions must be trustable, interpretable, maintainable, scalable, and evaluated in context. To cope with these challenges, in this article we report our process of building an AIOps solution for predicting node failures for an ultra-large-scale cloud computing platform at Alibaba. We expect our experiences to be of value to researchers and practitioners, who are interested in building and maintaining AIOps solutions for large-scale cloud computing platforms.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Breiman, L. (2001) · Machine Learning · doi:10.1023/a:1010933404324 · Cited by 133,538
Greff, K., Srivastava, R. K., Koutnik, J., Steunebrink, B. R., & Schmidhuber, J. (2017) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2016.2582924 · Cited by 6,955 · cited 3×
“• LSTM: LSTM is a deep neural network–based ML algorithm commonly used for predicting time-series data [18].”
MethodKuhn, M., & Johnson, K. (2013) · doi:10.1007/978-1-4614-6849-3 · Cited by 6,788
A few useful things to know about machine learning
Domingos, P. (2012) · Communications of the ACM · doi:10.1145/2347736.2347755 · Cited by 3,326 · cited 1×
“Feature engineering is generally considered as a key step in a successful ML project, as the performance of an ML model is highly dependent on its features [1, 11].”
BackgroundAn Empirical Comparison of Model Validation Techniques for Defect Prediction Models
Tantithamthavorn, C., McIntosh, S., Hassan, A. E., & Matsumoto, K. (2017) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2016.2584050 · Cited by 574
Self-citationTowards trustable machine learning
(2018) · Nature Biomedical Engineering · doi:10.1038/s41551-018-0315-x · Cited by 64
Practical scrubbing: Getting to the bad sector at the right time
Amvrosiadis, G., Oprea, A., & Schroeder, B. (2012) · IEEE/IFIP International Conference on Dependable Systems and Networks (DSN 2012) · doi:10.1109/dsn.2012.6263919 · Cited by 20
Cited by
A survey of AIOps methods for failure management
Notaro, P., Cardoso, J., & Gerndt, M. (2021) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3483424 · Cited by 142
LogAssist: Assisting Log Analysis Through Log Summarization
Locke, S., Li, H., Chen, T.-H., Shang, W., & Liu, W. (2022) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2021.3083715 · Cited by 45
Self-citationMicroservice Anomaly Detection Based on Tracing Data Using Semi-supervised Learning
Li, M., Tang, D., Wen, Z., & Cheng, Y. (2021) · 2021 4th International Conference on Artificial Intelligence and Big Data (ICAIBD) · doi:10.1109/icaibd51990.2021.9459100 · Cited by 11
Is your anomaly detector ready for change? Adapting aiops solutions to the real world
Poenaru-Olaru, L., Karpova, N., Cruz, L., Rellermeyer, J. S., & van Deursen, A. (2024) · Proceedings of the IEEE/ACM 3rd International Conference on AI Engineering - Software Engineering for AI · doi:10.1145/3644815.3644961 · Cited by 7
Metadata
- Authors
- Li, Y., Jiang, Z. M. (., Li, H., Hassan, A. E., He, C., Huang, R., Zeng, Z., Wang, M., & Chen, P.
- Venue
- ACM Transactions on Software Engineering and Methodology
- Published
- 2020-04-29
- Volume
- 29
- Issue
- 2
- Pages
- 1-24
- ISSN
- 1049-331X (ISSN-L)
- 1557-7392
- OpenAlex
- W3040857534
- Cited by
- 82
- References
- 7
- FWCI
- 5.30
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Predicting Node Failures in an Ultra-Large-Scale Cloud Computing Platform: An AIOps Solution. https://app.cochat.ai/papers/10.1145/3385187
- The paper
- Li, Y., Jiang, Z. M. (., Li, H., Hassan, A. E., He, C., Huang, R., Zeng, Z., Wang, M., & Chen, P. (2020). Predicting Node Failures in an Ultra-Large-Scale Cloud Computing Platform: An AIOps Solution. ACM Transactions on Software Engineering and Methodology. https://doi.org/10.1145/3385187
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.