A Real-Time Trace-Level Root-Cause Diagnosis System in Alibaba Datacenters
Open accessThe DOI matches its Crossref record; 2 of the 2 references it cites were found in a registry or an index.
Abstract
Root-cause analysis (RCA) for service performance degradation can be a challenging exercise given the increasingly complex, inter-related, distributed infrastructure environment in today's enterprises. Many approaches have been applied into enterprise datacenters to improve the maintenance efficiency. A novel graph-level RCA approach is introduced in this paper, including tracing, weighted graph matching and suspicion ranking. The approach is developed based on performance profiling, tracing, and logging systems in Alibaba datacenters to speed up the real-time root-cause diagnosis. Our system allows the discovery of normative patterns and the corresponding key graph properties, which are stored and updated offline as a knowledge base for subsequently being used in trace-level risk estimation and identification of transitions that are unexpected deviations from the normative patterns. Through testing in production, we show the effectiveness of applying the graph-level RCA to discover the origins of problems and generate real-time operational support. It greatly decreases the workload for locating the root-cause of the anomaly.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Latent Space Approaches to Social Network Analysis
Hoff, P. D., Raftery, A. E., & Handcock, M. S. (2002) · Journal of the American Statistical Association · doi:10.1198/016214502388618906 · Cited by 1,917
Graph based anomaly detection and description: a survey
Akoglu, L., Tong, H., & Koutra, D. (2015) · Data Mining and Knowledge Discovery · doi:10.1007/s10618-014-0365-y · Cited by 1,504 · cited 1×
“Our work is heavily inspired by the past literature that details the graph-based anomaly detection analysis [17]–[20].”
Method
Cited by
MicroHECL: High-Efficient Root Cause Localization in Large-Scale Microservice Systems
Liu, D., He, C., Peng, X., Lin, F., Zhang, C., Gong, S., Li, Z., Ou, J., & Wu, Z. (2021) · 2021 IEEE/ACM 43rd International Conference on Software Engineering: Software Engineering in Practice (ICSE-SEIP) · doi:10.1109/icse-seip52600.2021.00043 · Cited by 192
Sieve: Attention-based Sampling of End-to-End Trace Data in Distributed Microservice Systems
Huang, Z., Chen, P., Yu, G., Chen, H., & Zheng, Z. (2021) · 2021 IEEE International Conference on Web Services (ICWS) · doi:10.1109/icws53863.2021.00063 · Cited by 22
Analysis of Log Files to Enable Smart-Troubleshooting in Industry 4.0: A Systematic Mapping Study
Partovian, S., Bucaioni, A., Flammini, F., & Thornadtsson, J. (2024) · IEEE Access · doi:10.1109/access.2023.3342365 · Cited by 16
AAMR: Automated Anomalous Microservice Ranking in Cloud-Native Environment
Zhang, Z. (2021) · International Conferences on Software Engineering and Knowledge Engineering · doi:10.18293/seke2021-091 · Cited by 10
Metadata
- Authors
- Cai, Z., Li, W., Zhu, W., Liu, L., & Yang, B.
- Venue
- IEEE Access
- Published
- 2019
- Volume
- 7
- Pages
- 142692-142702
- ISSN
- 2169-3536 (ISSN-L)
- OpenAlex
- W2977317487
- Cited by
- 20
- References
- 2
- FWCI
- 1.38
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: A Real-Time Trace-Level Root-Cause Diagnosis System in Alibaba Datacenters. https://app.cochat.ai/papers/10.1109/access.2019.2944456
- The paper
- Cai, Z., Li, W., Zhu, W., Liu, L., & Yang, B. (2019). A Real-Time Trace-Level Root-Cause Diagnosis System in Alibaba Datacenters. IEEE Access. https://doi.org/10.1109/access.2019.2944456
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.