The DOI matches its Crossref record; 35 of the 36 references it cites were found in a registry or an index.
Root Cause Analysis for Microservice System based on Causal Inference: How Far Are We?
Open accessAbstract
Microservice architecture has become a popular architecture adopted by many cloud applications. However, identifying the root cause of a failure in microservice systems is still a challenging and time-consuming task. In recent years, researchers have introduced various causal inference-based root cause analysis methods to assist engineers in identifying the root causes. To gain a better understanding of the current status of causal inference-based root cause analysis techniques for microservice systems, we conduct a comprehensive evaluation of nine causal discovery methods and twenty-one root cause analysis methods. Our evaluation aims to understand both the effectiveness and efficiency of causal inference-based root cause analysis methods, as well as other factors that affect their performance. Our experimental results and analyses indicate that no method stands out in all situations; each method tends to either fall short in effectiveness, efficiency, or shows sensitivity to specific parameters. Notably, the performance of root cause analysis methods on synthetic datasets may not accurately reflect their performance in real systems. Indeed, there is still a large room for further improvement. Furthermore, we also suggest possible future work based on our findings.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The RE1 dataset, which includes 3 resource faults and 2 network faults, was used in our previous metric-based RCA works [6].”
From RCAEval: A Benchmark for Root Cause Analysis of Microservice Systems with Telemetry Data (2025) · cites this paper as [6]
In the citing paper
“Metric-based RCA baselines include causal inference-based methods such as RUN, CausalRCA, CIRCA, RCD, MicroCause, EasyRCA, MSCRED, as well as noncausal methods such as BARO, and 𝜖-Diagnosis [6,8,10,14].”
From RCAEval: A Benchmark for Root Cause Analysis of Microservice Systems with Telemetry Data (2025) · cites this paper as [6]
In the citing paper
“Pham et.al. [6] evaluates only on metric-based RCA methods.”
From RCAEval: A Benchmark for Root Cause Analysis of Microservice Systems with Telemetry Data (2025) · cites this paper as [6]
In the citing paper
“The RCAEval evaluation framework is an extension of our previous work [6], which focused on metric-based RCA and coarse-grained RCA.”
From RCAEval: A Benchmark for Root Cause Analysis of Microservice Systems with Telemetry Data (2025) · cites this paper as [6]
In the citing paper
“The RE1 dataset, introduced in our prior work on metric-based RCA [6], contains 375 failure cases collected from three microservice systems (125 cases per system).”
From RCAEval: A Benchmark for Root Cause Analysis of Microservice Systems with Telemetry Data (2025) · cites this paper as [6]
4 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Estimating the Dimension of a Model
Schwarz, G. (1978) · The Annals of Statistics · doi:10.1214/aos/1176344136 · Cited by 47,033
The anatomy of a large-scale hypertextual Web search engine
Brin, S., & Page, L. (1998) · Computer Networks and ISDN Systems · doi:10.1016/s0169-7552(98)00110-x · Cited by 16,004
Proceedings of the 25th international conference on Machine learning - ICML '08
(2008) · doi:10.1145/1390156 · Cited by 6,680
Basic concepts and taxonomy of dependable and secure computing
Avizienis, A., Laprie, J.-C., Randell, B., & Landwehr, C. (2004) · IEEE Transactions on Dependable and Secure Computing · doi:10.1109/tdsc.2004.2 · Cited by 5,223
Advances in Neural Information Processing Systems 32 (NeurIPS 2019)
Wallach, H., Larochelle, H., Beygelzimer, A., d’Alché–Buc, F., Fox, E. B., & Garnett, R. (2020) · HAL · Cited by 2,451
A Linear Non-Gaussian Acyclic Model for Causal Discovery
Shimizu, S., Hoyer, P. O., Hyvärinen, A., & Kerminen, A. (2006) · Cited by 2,231
Granger, C. W. J. (1980) · Journal of Economic Dynamics and Control · doi:10.1016/0165-1889(80)90069-x · Cited by 1,746
The pains and gains of microservices: A Systematic grey literature review
Soldani, J., Tamburri, D. A., & Van Den Heuvel, W.-J. (2018) · Journal of Systems and Software · doi:10.1016/j.jss.2018.09.082 · Cited by 435
Zhou, X., Peng, X., Xie, T., Sun, J., Ji, C., Li, W., & Ding, D. (2021) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2018.2887384 · Cited by 410
Lindley, D. V., & Spitzer, F. (1965) · The Statistician · doi:10.2307/2987393 · Cited by 350
Research works printed but not linked: 25
- 2023. The Istio service mesh. Retrieved Oct 10, 2023 from https://istio.io/
- 2023. An open-source monitoring and alerting toolkit. Retrieved Oct 10, 2023 from https://prometheus.io/
- Devansh Arpit Matthew Fernandez Itai Feigenbaum Weiran Yao Chenghao Liu Wenzhuo Yang Paul Josel Shelby Heinecke Eric Hu Huan Wang Stephen Hoi Caiming Xiong Kun Zhang and Juan Carlos Niebles. 2023. Salesforce CausalAI Library: A Fast and Scalable framework for Causal Analysis of Time Series and Tabular Data. (2023). arXiv:arXiv preprint arXiv:2301.10859 [cs.LG] · arXiv
- Charles K. Assaad, Emilie Devijver, and Eric Gaussier. 2022. Survey and Evaluation of Causal Discovery Methods for Time Series. Journal of Artificial Intelligence Research 73 (2022).
- Konstantina Biza, Ioannis Tsamardinos, and Sofia Triantafillou. 2020. Tuning causal discovery algorithms. In International Conference on Probabilistic Graphical Models. PMLR, 17--28.
- Junjie Chen, Xiaoting He, Qingwei Lin, Yong Xu, Hongyu Zhang, Dan Hao, Feng Gao, Zhangwei Xu, Yingnong Dang, and Dongmei Zhang. 2019. An Empirical Investigation of Incident Triage for Online Service Systems. In 2019 IEEE/ACM 41st International Conference on Software Engineering: Software Engineering in Practice (ICSE-SEIP). 111--120.
- Yujun Chen, Xian Yang, Qingwei Lin, Hongyu Zhang, Feng Gao, Zhangwei Xu, Yingnong Dang, Dongmei Zhang, Hang Dong, Yong Xu, Hao Li, and Yu Kang. 2019. Outage Prediction and Diagnosis for Cloud Service Systems. In The World Wide Web Conference (San Francisco, CA, USA) (WWW '19). Association for Computing Machinery, New York, NY, USA, 2659--2665.
- Clark Glymour, Kun Zhang, and Peter Spirtes. 2019. Review of Causal Discovery Methods Based on Graphical Models. Frontiers in Genetics 10 (2019).
- Azam Ikram, Sarthak Chakraborty, Subrata Mitra, Shiv Saini, Saurabh Bagchi, and Murat Kocaoglu. 2022. Root Cause Analysis of Failures in Microservices through Causal Discovery. In Advances in Neural Information Processing Systems (NeurIPS'22), Vol. 35. 31158--31170.
- Amin Jaber, Murat Kocaoglu, Karthikeyan Shanmugam, and Elias Bareinboim. 2020. Causal Discovery from Soft Interventions with Unknown Targets: Characterization and Learning. In Advances in Neural Information Processing Systems (NeurIPS'20), Vol. 33. 9551--9561.
- Cheryl Lee, Tianyi Yang, Zhuangbin Chen, Yuxin Su, and Michael R Lyu. 2023. Eadro: An End-to-End Troubleshooting Framework for Microservices on Multi-source Data. arXiv preprint arXiv:2302.05092 (2023). · arXiv
- Cheng-Ming Lin, Ching Chang, Wei-Yao Wang, Kuang-Da Wang, and Wen-Chih Peng. 2024. Root Cause Analysis in Microservice Using Neural Granger Causal Discovery. In Thirty-Eighth AAAI Conference on Artificial Intelligence. 206--213.
- Jinjin Lin, Pengfei Chen, and Zibin Zheng. 2018. Microscope: Pinpoint Performance Issues with Causal Graphs in Micro-service Environments. In Service-Oriented Computing. 3--20.
- Chenghao Liu, Wenzhuo Yang, Himanshu Mittal, Manpreet Singh, Doyen Sahoo, and Steven CH Hoi. 2023. PyRCA: A Library for Metric-based Root Cause Analysis. arXiv preprint arXiv:2306.11417 (2023). · arXiv
- Meng Ma, Weilan Lin, Disheng Pan, and Ping Wang. 2019. MS-Rank: Multi-Metric and Self-Adaptive Root Cause Diagnosis for Microservice Applications. In IEEE International Conference on Web Services (ICWS'19). 60--67.
- Vineet K Raghu, Allen Poon, and Panayiotis V Benos. 2018. Evaluation of causal structure learning methods on mixed data types. In Proceedings of 2018 ACM SIGKDD Workshop on Causal Discovery. PMLR, 48--65.
- Jakob Runge, Peer Nowack, Marlene Kretschmer, Seth Flaxman, and Dino Sejdinovic. 2019. Detecting and quantifying causal associations in large nonlinear time series datasets. Science Advances 5, 11 (2019).
- 10.5555/1248547.1248619 · doi:10.5555/1248547.1248619
- Julien Siebert. 2023. Applications of statistical causal inference in software engineering. Information and Software Technology 159 (2023).
- Jacopo Soldani and Antonio Brogi. 2022. Anomaly Detection and Failure Root Cause Analysis in (Micro) Service-Based Cloud Applications: A Survey. Comput. Surveys 55, 3 (2022).
- Matthew J. Vowels, Necati Cihan Camgoz, and Richard Bowden. 2022. D'Ya Like DAGs? A Survey on Structure Learning and Causal Discovery. Comput. Surveys 55, 4, Article 82 (2022).
- Ping Wang, Jingmin Xu, Meng Ma, Weilan Lin, Disheng Pan, Yuan Wang, and Pengfei Chen. 2018. CloudRanger: Root Cause Identification for Cloud Native Systems. In 18th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (CCGRID'18). 492--502.
- Qing Wang, Larisa Shwartz, Genady Ya. Grabarnik, Vijay Arya, and Karthikeyan Shanmugam. 2021. Detecting Causal Structure on Cloud Application Microservices Using Granger Causality Models. In IEEE 14th International Conference on Cloud Computing (CLOUD'21). 558--565.
- Li Wu, Johan Tordsson, Jasmin Bogatinovski, Erik Elmroth, and Odej Kao. 2021. MicroDiag: Fine-grained Performance Diagnosis for Microservice Systems. In 2021 IEEE/ACM International Workshop on Cloud Intelligence. 31--36.
- Xun Zheng, Bryon Aragam, Pradeep K Ravikumar, and Eric P Xing. 2018. Dags with no tears: Continuous optimization for structure learning. Advances in neural information processing systems 31 (2018).
Cited by
RCAEval: A Benchmark for Root Cause Analysis of Microservice Systems with Telemetry Data
Pham, L., Zhang, H., Ha, H., Salim, F., & Zhang, X. (2025) · Companion Proceedings of the ACM on Web Conference 2025 · doi:10.1145/3701716.3715290 · Cited by 72
Self-citationHao, J., Chen, P., Chen, J., & Li, X. (2025) · Information Processing & Management · doi:10.1016/j.ipm.2025.104107 · Cited by 65
Root Cause Analysis of Outliers with Missing Structural Knowledge
Orchard, W. R., Okati, N., Mejia, S. H. G., Blöbaum, P., & Janzing, D. (2025) · neural information processing systems · doi:10.52202/085713-5399 · Cited by 27
Wang, P., Zhang, X., & Cao, Z. (2025) · Information Fusion · doi:10.1016/j.inffus.2025.103017 · Cited by 19
GALA: Can Graph-Augmented Large Language Model Agentic Workflows Elevate Root Cause Analysis?Preprint
Tian, Y., Liu, Y., Chong, Z., Huang, Z., & Jacobsen, H. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2508.12472 · Cited by 18
Metadata
- Authors
- Pham, L., Ha, H., & Zhang, H.
- Affiliations
- RMIT University (AU)
- Chongqing University (CN)
- Venue
- Proceedings of the 39th IEEE/ACM International Conference on Automated Software Engineering
- Publisher
- ACM
- Published
- 2024-10-27
- Pages
- 706-715
- OpenAlex
- W4403536391
- Cited by
- 38
- References
- 36
- Citations by year
- 2026: 29 · 2025: 8 · 2024: 1
- FWCI
- 16.64
- Type
- conference paper
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- IEEE/ACM International Conference on Automated Software Engineering (ASE) (publishedVersion, cc-by)
- arXiv (Cornell University) (submittedVersion, cc-by)
- arXiv (Cornell University) (cc-by)
- Funders
- Australian Research Council Discovery Project (DP220103044)
- Topics
- Physical Sciences › Computer Science › Computer Networks and Communications › Software System Performance and Reliability
- Physical Sciences › Computer Science › Information Systems › Software Engineering Research
- Physical Sciences › Computer Science › Software › Software Testing and Debugging Techniques
- Keywords
- root cause analysis, microservices, causal inference, causal discovery, fault diagnosis, cloud applications, method evaluation, synthetic dataset, performance sensitivity
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.