Self-Adaptive Root Cause Diagnosis for Large-Scale Microservice Architecture
The DOI matches its Crossref record; 31 of the 32 references it cites were found in a registry or an index.
Abstract
The emergence of microservice architecture in Cloud systems poses a new challenges for the reliability operation and maintenance. Due to numerous services and diverse types of metrics, it is time-consuming and challenging to identify the root cause of anomaly in large-scale microservice architecture. To solve this issue, this article presents a multi-metric and self-adaptive root cause diagnosis framework, named MS-Rank. MS-Rank decomposes the task into four phases: impact graph construction, random walk diagnosis, result precision evaluation, metrics weight update. Initially, we introduce the concept of implicit metrics and propose a composite impact graph construction algorithm, using multiple types of metrics to discover causal relationships between services. Afterwards, we propose a diagnostic algorithm in which forward, selfward and backward transitions are designed to heuristically identify the root cause services. In addition, we establish a self-adaptive mechanism to update the confidence of different metrics dynamically according to their diagnostic precision. Lastly, we develop a prototype system and integrate MS-Rank into real production system - IBM Cloud. Experimental results show that MS-Rank has a high diagnostic precision and its performance outperforms several selected benchmarks. Through multiple rounds of diagnosis, MS-Rank can optimize itself effectively. MS-Rank can be rapidly deployed in various microservice-based systems and applications, requiring no predefined knowledge. MS-Rank also allows us to introduce expert experiences into its framework to improve the diagnostic efficiency and precision.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“While service calling requirements are constantly changing, the functionalities of microservices are relatively consistent [56] [57].”
From Anomaly detection and root-cause identification in microservices: a survey (2026) · cites this paper as [57]
In the citing paper
“Systems such as MS-Rank [56,57], MicroDiag [97], and AutoMAP [96] use forward, backward, or self-transitions to replicate troubleshooting and prioritize highly correlated anomalies.”
From Anomaly detection and root-cause identification in microservices: a survey (2026) · cites this paper as [57]
Citations
Cites
Causation, Prediction, and Search
Spirtes, P., Glymour, C., & Scheines, R. (2001) · doi:10.7551/mitpress/1754.001.0001 · Cited by 4,521
Wiley Series in Probability and Statistics
(2008) · Wiley series in probability and statistics · doi:10.1002/series1345 · Cited by 4,217
Pearson Correlation Coefficient
Benesty, J., Chen, J., Huang, Y., & Cohen, I. (2009) · Springer Topics in Signal Processing · doi:10.1007/978-3-642-00296-0_5 · Cited by 3,059
Fault Detection and Diagnosis in Engineering Systems
Gertler, J. J. (2017) · CRC Press eBooks · doi:10.1201/9780203756126 · Cited by 1,999
Graph based anomaly detection and description: a survey
Akoglu, L., Tong, H., & Koutra, D. (2015) · Data Mining and Knowledge Discovery · doi:10.1007/s10618-014-0365-y · Cited by 1,504
Newman, S. (2015) · CERN Document Server (European Organization for Nuclear Research) · Cited by 794
Estimating high-dimensional directed acyclic graphs with the PC-algorithm
Kalisch, M., & Bühlmann, P. (2005) · arXiv (Cornell University) · doi:10.48550/arxiv.math/0510436 · Cited by 591
Order-independent constraint-based causal structure learning
Colombo, D., & Maathuis, M. H. (2014) · arXiv (Cornell University) · doi:10.5555/2627435.2750365 · Cited by 439
A characterization of Markov equivalence classes for acyclic digraphs
Andersson, S. A., Madigan, D., & Perlman, M. D. (1997) · The Annals of Statistics · doi:10.1214/aos/1031833662 · Cited by 425
A binary feedback scheme for congestion avoidance in computer networks
Ramakrishnan, K. K., & Jain, R. (1990) · ACM Transactions on Computer Systems · doi:10.1145/78952.78955 · Cited by 365
A survey of fault localization techniques in computer networks
Steinder, M. Ł., & Sethi, A. S. (2004) · Science of Computer Programming · doi:10.1016/j.scico.2004.01.010 · Cited by 358
Estimating High-Dimensional Directed Acyclic Graphs with the PC-Algorithm
KalischMarkus, & BühlmannPeter (2007) · Journal of Machine Learning Research · doi:10.5555/1248659.1248681 · Cited by 330
(2000) · CrossRef Listing of Deleted DOIs · doi:10.1162/153244302760200696 · Cited by 244
SherLog: error diagnosis by connecting clues from run-time logs
Yuan, D., Mai, H., Xiong, W., Tan, L., Zhou, Y., & Pasupathy, S. (2010) · ACM SIGARCH Computer Architecture News · doi:10.1145/1735970.1736038 · Cited by 212
Root cause detection in a service-oriented architecture
Kim, M., Sumbaly, R., & Shah, S. (2013) · ACM SIGMETRICS Performance Evaluation Review · doi:10.1145/2494232.2465753 · Cited by 138
Machine learning approaches to network anomaly detection
Ahmed, T., Oreshkin, B. N., & Coates, M. (2007) · Cited by 135
Towards highly reliable enterprise network services via inference of multi-level dependencies
Bahl, P., Chandra, R., Greenberg, A., Kandula, S., Maltz, D. A., & Zhang, M. (2007) · ACM SIGCOMM Computer Communication Review · doi:10.1145/1282427.1282383 · Cited by 125
Modeling and Tracking of Transaction Flow Dynamics for Fault Detection in Complex Systems
Jiang, G., Chen, H., & Yoshihira, K. (2006) · IEEE Transactions on Dependable and Secure Computing · doi:10.1109/tdsc.2006.52 · Cited by 91
Localizing Faults in Cloud Systems
Mariani, L., Monni, C., Pezze, M., Riganelli, O., & Xin, R. (2018) · 2018 IEEE 11th International Conference on Software Testing, Verification and Validation (ICST) · doi:10.1109/icst.2018.00034 · Cited by 77
Marwede, N., Rohr, M., van Hoorn, A., & Hasselbring, W. (2009) · 2009 13th European Conference on Software Maintenance and Reengineering · doi:10.1109/csmr.2009.15 · Cited by 63
Efficient and Scalable Algorithms for Inferring Likely Invariants in Distributed Systems
Jiang, G., Chen, H., & Yoshihira, K. (2007) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2007.190648 · Cited by 58
Detailed diagnosis in enterprise networks
Kandula, S., Mahajan, R., Verkaik, P., Agarwal, S., Padhye, J., & Bahl, P. (2009) · ACM SIGCOMM Computer Communication Review · doi:10.1145/1594977.1592597 · Cited by 57
Detecting Transient Bottlenecks in n-Tier Applications through Fine-Grained Analysis
Wang, Q., Kanemasa, Y., Li, J., Jayasinghe, D., Shimizu, T., Matsubara, M., Kawaba, M., & Pu, C. (2013) · 2013 IEEE 33rd International Conference on Distributed Computing Systems · doi:10.1109/icdcs.2013.17 · Cited by 50
Anomaly localization for network data streams with graph joint sparse PCA
Jiang, R., Fei, H., & Huan, J. (2011) · Proceedings of the 17th ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/2020408.2020557 · Cited by 47
Gao, J., Jiang, G., Chen, H., & Han, J. (2009) · 2009 29th IEEE International Conference on Distributed Computing Systems · doi:10.1109/icdcs.2009.56 · Cited by 42
VScope: Middleware for Troubleshooting Time-Sensitive Data Center Applications
Wang, C., Rayan, I. A., Eisenhauer, G., Schwan, K., Talwar, V., Wolf, M., & Huneycutt, C. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-35170-9_7 · Cited by 39
Learning the Dependence Graph of Time Series with Latent FactorsPreprint
Jalali, A., & Sanghavi, S. (2011) · arXiv (Cornell University) · doi:10.48550/arxiv.1106.1887 · Cited by 38
Gestalt: fast, unified fault localization for networked systems
Mysore, R. N., Mahajan, R., Vahdat, A. M., & Varghese, G. (2014) · Cited by 26
A distributed data streaming algorithm for network-wide traffic anomaly detection
Liu, Y., Zhang, L., & Guan, Y. (2009) · ACM SIGMETRICS Performance Evaluation Review · doi:10.1145/1639562.1639596 · Cited by 21
A Self-Optimizing Workload Management Solution for Cloud Applications
Wu, H., Tantawi, A. N., & Yu, T. (2013) · 2013 IEEE 20th International Conference on Web Services · doi:10.1109/icws.2013.71 · Cited by 21
Root-Cause Diagnosis for Rare Failures Using Bayesian Network with Dynamic Modification
Matsuo, Y., Nakano, Y., Watanabe, A., Watanabe, K., Ishibashi, K., & Kawahara, R. (2018) · International Conference on Communications · doi:10.1109/icc.2018.8422955 · Cited by 11
Research works printed but not linked: 1
- Roy, Passive realtime datacenter fault detection and localization, 595
Cited by
Soldani, J., & Brogi, A. (2023) · ACM Computing Surveys · doi:10.1145/3501297 · Cited by 256
“Such KPIs are also considered by MS-Rank [48, 49] and AutoMAP [50], in addition to the services’ availability and resource consumption.”
BackgroundMethodInfluentialRobust Failure Diagnosis of Microservice System Through Multimodal Data
Zhang, S., Jin, P., Lin, Z., Sun, Y., Zhang, B., Xia, S., Li, Z., Zhong, Z., Ma, M., Jin, W., et al. (2023) · IEEE Transactions on Services Computing · doi:10.1109/tsc.2023.3290018 · Cited by 118
“Many works try to build a dependency graph to depict the interaction between system components during failure, such as Microscope [11], MS-Rank [12], and AutoMAP [13].”
BackgroundMethodInfluentialSelf-citationXin, R., Chen, P., & Zhao, Z. (2023) · Journal of Systems and Software · doi:10.1016/j.jss.2023.111724 · Cited by 99
“CauseInfer [3], [15] PC BFS Service latency Faulty service Coarsegrained Micorscope [16], [17] Parallelized PC BFS Service latency Faulty service Coarsegrained CloudRanger [18] PC Random walk Service latenct Faulty service Coarsegrained MS-Rank [19], [20] PC Random walk Multi metrics Faulty service Coarsegrained AutoM…”
BackgroundMethodInterpretable Failure Localization for Microservice Systems Based on Graph Autoencoder
Sun, Y., Lin, Z., Shi, B., Zhang, S., Ma, S., Jin, P., Zhong, Z., Pan, L., Guo, Y., & Pei, D. (2024) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3695999 · Cited by 59
Robust KPI Anomaly Detection for Large-Scale Software Services with Partial Labels
Zhang, S., Zhao, C., Sui, Y., Su, Y., Sun, Y., Zhang, Y., Pei, D., & Wang, Y. (2021) · Proceedings/Proceedings - International Symposium on Software Reliability Engineering · doi:10.1109/issre52982.2021.00023 · Cited by 30
Metadata
- Authors
- Ma, M., Lin, W., Pan, D., & Wang, P.
- Affiliations
- Peking University (CN)
- ORCID
- Venue
- IEEE Transactions on Services Computing
- Published
- 2022-05-01
- Volume
- 15
- Issue
- 3
- Pages
- 1399-1410
- ISSN
- 1939-1374 (ISSN-L)
- 2372-0204
- OpenAlex
- W3022004659
- Cited by
- 37
- References
- 32
- Citations by year
- 2026: 6 · 2025: 9 · 2024: 11 · 2023: 7 · 2022: 2
- FWCI
- 1.29
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- Locations
- IEEE Transactions on Services Computing (publishedVersion)
- Funders
- National Key Research and Development Program of China (2017YFB1200700)
- National Defense Key Laboratory of Science & Technology on Reliability & Environmental Engineering (6142004180403)
- National Natural Science Foundation of China (61701007)
- IBM Shared University
- Topics
- Physical Sciences › Computer Science › Computer Networks and Communications › Software System Performance and Reliability
- Physical Sciences › Computer Science › Information Systems › Cloud Computing and Resource Management
- Physical Sciences › Computer Science › Computer Networks and Communications › Distributed systems and fault tolerance
- Keywords
- root cause diagnosis, microservices, anomaly diagnosis, random walks
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.