HeMiRCA: Fine-Grained Root Cause Analysis for Microservices with Heterogeneous Data Sources
The DOI matches its Crossref record; 39 of the 39 references it cites were found in a registry or an index.
Abstract
Microservices architecture improves software scalability, resilience, and agility but also poses significant challenges to system reliability due to their complexity and dynamic nature. Identifying and resolving anomalies promptly is crucial because they can quickly propagate to other microservices and cause severe damage to the system. Existing root-cause metric localization approaches rely on metrics or metrics-anomalies correlations but overlook other monitoring data sources (e.g., traces). We are the first to identify and leverage the anomaly-aware monotonic correlation between heterogeneous monitoring data, motivated by which we propose a novel framework, Heterogeneous data sources in Microservice systems for Root Cause Analysis (HeMiRCA) , for hierarchical root cause analysis using Spearman correlation. HeMiRCA is based on the key observation that the microservice responsible for a particular type of fault exhibits a monotonic correlation between the trends of its associated metrics and the trace-based anomaly score of the system. HeMiRCA first calculates time-series anomaly scores using traces and then exploits the correlations between multivariate metrics and the scores to rank the suspicious metrics and microservices. HeMiRCA has been evaluated on two datasets collected from widely used microservice systems. The results show that HeMiRCA outperforms the state-of-the-art approaches by a large margin in identifying root causes at both service level and metric level, ac…
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Direct LLM output is brittle when used alone.Correctness comes from verifiers, repair loops, and explicit checks around the generator [75], [89], [90].”
From Large language models for agentic NetOps and AIOps: Architectures, evaluation, and safety (2027) · cites this paper as [75]
In the citing paper
“Instead, the LLM is most valuable as a controller of workflow: it translates intent into queries, routes evidence through verifiers, proposes minimally invasive diffs, and documents preconditions and rollback [9], [75], [76].”
From Large language models for agentic NetOps and AIOps: Architectures, evaluation, and safety (2027) · cites this paper as [75]
In the citing paper
“Recent work makes ambiguity explicit and studies how an LLM-driven assistant should ask questions before generating configurations [114], [75].”
From Large language models for agentic NetOps and AIOps: Architectures, evaluation, and safety (2027) · cites this paper as [75]
Citations
Cites
Bayesian Inference in Econometric Models Using Monte Carlo Integration
Geweke, J. (1989) · Econometrica · doi:10.2307/1913710 · Cited by 1,563 · cited 1×
“Monte Carlo integration [14] is often adopted to approximate the expectation in Equation 1, as Equation 2, where ( 𝑙 ) , 𝑙 = 1 , . . . , 𝐿 are samples from 𝑞 𝜙 ( 𝑧 | 𝑥 ) .”
Noise Reduction in Speech Processing
Cohen, I., Huang, Y., Chen, J., & Benesty, J. (2009) · Springer Topics in Signal Processing · doi:10.1007/978-3-642-00296-0 · Cited by 1,459
Encyclopedia of measurement and statistics
(2007) · Choice Reviews Online · doi:10.5860/choice.44-4214 · Cited by 1,385
(2015) · Cited by 1,279
Heaton, J. (2018) · Genetic Programming and Evolvable Machines · doi:10.1007/s10710-017-9314-z · Cited by 1,054
Gan, Y., Zhang, Y., Cheng, D., Shetty, A., Rathi, P., Katarki, N., Bruno, A., Hu, J., Ritchken, B., Jackson, B., et al. (2019) · Proceedings of the Twenty-Fourth International Conference on Architectural Support for Programming Languages and Operating Systems · doi:10.1145/3297858.3304013 · Cited by 665 · cited 2×
“These datasets were collected from widely-used microservice benchmark systems, namely TrainTicket [57] and SocialNetwork [13], which contain multi-source data, including metrics and traces.”
MethodProceedings of the VLDB Endowment
Alonso, G., Freire, J., Saçan, A., & Tatbul, N. (2011) · Cited by 653
Experience Report: System Log Analysis for Anomaly Detection
He, S., Zhu, J., He, P., & Lyu, M. R. (2016) · 2016 IEEE 27th International Symposium on Software Reliability Engineering (ISSRE) · doi:10.1109/issre.2016.21 · Cited by 593 · cited 1×
“In service-oriented software engineering, a variety of monitoring data play an essential role in maintaining the stability and reliability of microservice systems, such as metrics, traces, alerts, and logs [5, 7, 22, 34, 49].”
BackgroundSelf-citationZar, J. H. (2005) · Encyclopedia of Biostatistics · doi:10.1002/0470011815.b2a15150 · Cited by 566 · cited 2×
“This is crucial in environments where anomalies may not scale directly with metrics but still show a consistent direction, offering clearer insights into causal connections.”
Zhou, X., Peng, X., Xie, T., Sun, J., Ji, C., Li, W., & Ding, D. (2021) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2018.2887384 · Cited by 410
The Deluge of Spurious Correlations in Big Data
Calude, C. S., & Longo, G. (2017) · Foundations of Science · doi:10.1007/s10699-016-9489-4 · Cited by 385 · cited 1×
“These techniques can enable a bare microservice system with the ability of heterogeneous data collection, facilitating the coordination of the sampling frequency of different data sources.”
A Survey on Automated Log Analysis for Reliability Engineering
He, S., He, P., Chen, Z., Yang, T., Su, Y., & Lyu, M. R. (2022) · ACM Computing Surveys · doi:10.1145/3460345 · Cited by 334 · cited 1×
“Logs are semi-structured text generated by logging statements in software source code [21].”
MethodSelf-citationProceedings of the 44th International Conference on Software Engineering
(2022) · doi:10.1145/3510003 · Cited by 326
Characterizing Microservice Dependency and Performance: Alibaba Trace Analysis
Luo, S., Xu, H., Lu, C., Ye, K., Xu, G., Zhang, L., Ding, Y., He, J., & Xu, C. (2021) · Proceedings of the ACM Symposium on Cloud Computing · doi:10.1145/3472883.3487003 · Cited by 293 · cited 1×
“Microservice architecture allows the cloud-native enterprise to develop an application as a suite of small, independent, and loosely coupled services that can be developed, tested, and deployed separately [36].”
BackgroundZhou, X., Peng, X., Xie, T., Sun, J., Ji, C., Liu, D., Xiang, Q., & He, C. (2019) · Proceedings of the 2019 27th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering · doi:10.1145/3338906.3338961 · Cited by 277 · cited 2×
“The network-related metric “ rx bytes ” may have a range from 0 to 992, while the metric “ memory usage ” may have a range from 0 to 0.048.”
InfluentialMicroRCA: Root Cause Localization of Performance Issues in Microservices
Wu, L., Tordsson, J., Elmroth, E., & Kao, O. (2020) · NOMS 2020 - 2020 IEEE/IFIP Network Operations and Management Symposium · doi:10.1109/noms47738.2020.9110353 · Cited by 265 · cited 1×
“To what extent do the correlation analysis methods and data alignment contribute to the effectiveness of HeMiRCA?”
Soldani, J., & Brogi, A. (2023) · ACM Computing Surveys · doi:10.1145/3501297 · Cited by 256
Unsupervised Detection of Microservice Trace Anomalies through Service-Level Deep Bayesian Networks
Liu, P., Xu, H., Ouyang, Q., Jiao, R., Chen, Z., Zhang, S., Yang, J., Mo, L., Zeng, J., Xue, W., et al. (2020) · 2020 IEEE 31st International Symposium on Software Reliability Engineering (ISSRE) · doi:10.1109/issre5003.2020.00014 · Cited by 252 · cited 6×
“Some approaches rely on traces [25, 26, 33, 41] because traces record essential inter-service information (e.g., request duration), while others rely on metrics [11, 32, 39, 40, 43, 45] since metrics reflect diverse aspects of the system status (e.g., CPU usages, network).”
InfluentialBenchmarking microservice systems for software engineering research
Zhou, X., Peng, X., Xie, T., Sun, J., Xu, C., Ji, C., & Zhao, W. (2018) · Proceedings of the 40th International Conference on Software Engineering: Companion Proceeedings · doi:10.1145/3183440.3194991 · Cited by 168
Localizing Failure Root Causes in a Microservice through Causality Inference
Meng, Y., Zhang, S., Sun, Y., Zhang, R., Hu, Z., Zhang, Y., Jia, C., Wang, Z., & Pei, D. (2020) · 2020 IEEE/ACM 28th International Symposium on Quality of Service (IWQoS) · doi:10.1109/iwqos49365.2020.9213058 · Cited by 161 · cited 5×
“By following these steps, practitioners can effectively utilize our method to perform root cause analysis in their systems, aiding in the timely identification and resolution of anomalies.”
InfluentialYu, G., Chen, P., Chen, H., Guan, Z., Huang, Z., Jing, L., Weng, T., Sun, X., & Li, X. (2021) · Proceedings of the Web Conference 2021 · doi:10.1145/3442381.3449905 · Cited by 158 · cited 1×
“We regard the adoption of industrial datasets as important future work.”
Chen, P., Qi, Y., Zheng, P., & Hou, D. (2014) · IEEE INFOCOM 2014 - IEEE Conference on Computer Communications · doi:10.1109/infocom.2014.6848128 · Cited by 140 · cited 1×
“Chen et al. , proposed CauseInfer, which constructed a two-layered hierarchical causal graph of the distributed system [6].”
BackgroundRoot cause detection in a service-oriented architecture
Kim, M., Sumbaly, R., & Shah, S. (2013) · ACM SIGMETRICS Performance Evaluation Review · doi:10.1145/2494232.2465753 · Cited by 138
Correlating events with time series for incident diagnosis
Chen, L., Lou, J., Lin, Q., Fu, Q., Ding, R. F., Zhang, D., & Wang, Z. (2014) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/2623330.2623374 · Cited by 134 · cited 2×
“• Nearest Neighbor Method [35]: Similar to [45], both of them assume that the true root-cause metric must change drastically when a failure occurs.”
BackgroundAutoMAP: Diagnose Your Microservice-based Web Applications Automatically
Ma, M., Xu, J., Wang, Y., Chen, P., Zhang, Z., & Wang, P. (2020) · Proceedings of The Web Conference 2020 · doi:10.1145/3366423.3380111 · Cited by 129 · cited 3×
“The most basic way involves a systematic methodology for visually comparing traces, allowing operators to manually identify issues within the anomalous traces associated with observed anomalies.”
Microservices in Practice, Part 1: Reality Check and Service Design
Pautasso, C., Zimmermann, O., Amundsen, M., Lewis, J., & Josuttis, N. (2017) · IEEE Software · doi:10.1109/ms.2017.24 · Cited by 121 · cited 1×
“These benefits of microservices architecture have led to its widespread adoption by leading Internet companies like Amazon, Google, and Netflix [42], as well as many other organizations that are transitioning from monolithic systems to microservices [19].”
BackgroundGraph-based trace analysis for microservice architecture understanding and problem diagnosis
Guo, X., Peng, X., Wang, H., Li, W., Jiang, H., Ding, D., Xie, T., & Su, L. (2020) · Proceedings of the 28th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering · doi:10.1145/3368089.3417066 · Cited by 118 · cited 1×
“We regard the adoption of industrial datasets as important future work.”
Towards intelligent incident management: why we need it and how we make it
Chen, Z., Kang, Y., Li, L., Zhang, X., Zhang, H., Xu, H., Zhou, Y., Yang, L., Sun, J., Xu, Z., et al. (2020) · Proceedings of the 28th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering · doi:10.1145/3368089.3417055 · Cited by 99 · cited 1×
“In service-oriented software engineering, a variety of monitoring data play an essential role in maintaining the stability and reliability of microservice systems, such as metrics, traces, alerts, and logs [5, 7, 22, 34, 49].”
BackgroundShan, H., Chen, Y., Li, X., Zhang, Y., Xiao, X., He, X., Li, M., & Ding, W. (2019) · International World Wide Web Conference (WWW) · doi:10.1145/3308558.3313653 · Cited by 87 · cited 4×
“Some approaches rely on traces [25, 26, 33, 41] because traces record essential inter-service information (e.g., request duration), while others rely on metrics [11, 32, 39, 40, 43, 45] since metrics reflect diverse aspects of the system status (e.g., CPU usages, network).”
BackgroundInfluentialRoot-Cause Metric Location for Microservice Systems via Log Anomaly Detection
Wang, L., Zhao, N., Chen, J., Li, P., Zhang, W., & Sui, K. (2020) · 2020 IEEE International Conference on Web Services (ICWS) · doi:10.1109/icws49710.2020.00026 · Cited by 84 · cited 3×
“The network-related metric “ rx bytes ” may have a range from 0 to 992, while the metric “ memory usage ” may have a range from 0 to 0.048.”
InfluentialData-driven root-cause fault diagnosis for multivariate non-linear processes
Rashidi, B., Singh, D. S., & Zhao, Q. Z. (2017) · Control Engineering Practice · doi:10.1016/j.conengprac.2017.09.021 · Cited by 68
Diagnosing Performance Issues in Microservices with Heterogeneous Data Source
Hou, C., Jia, T., Wu, Y., Li, Y., & Han, J. (2021) · 2021 IEEE Intl Conf on Parallel & Distributed Processing with Applications, Big Data & Cloud Computing, Sustainable Computing & Communications, Social Computing & Networking (ISPA/BDCloud/SocialCom/SustainCom) · doi:10.1109/ispa-bdcloud-socialcom-sustaincom52081.2021.00074 · Cited by 54 · cited 1×
“Therefore, it is imperative to investigate the potential correlations between different types of data sources to improve the accuracy and granularity of RCA.”
Unsupervised Anomaly Detection on Microservice Traces through Graph VAE
Xie, Z., Xu, H., Chen, W., Li, W., Jiang, H., Su, L., Wang, H., & Pei, D. (2023) · Proceedings of the ACM Web Conference 2023 · doi:10.1145/3543507.3583215 · Cited by 54 · cited 1×
“These models identify normal regions in the original or latent feature space and measure the anomaly score based on how far an observation deviates from these regions.”
Jin, M., Lv, A., Zhu, Y., Wen, Z., Zhong, Y., Zhao, Z., Wu, J., Li, H., He, H., & Chen, F. (2020) · IEEE Access · doi:10.1109/access.2020.3044610 · Cited by 50
Chen, A. R., Chen, T.-H., & Wang, S. (2022) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2021.3071473 · Cited by 47
Gu, S., Rong, G., Ren, T., Zhang, H., Shen, H., Yu, Y., Li, X., Ouyang, J., & Chen, C. (2023) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2023.3241299 · Cited by 46 · cited 1×
“The idea is that the higher the correlation between the metrics monitored on an anomalous service and those monitored in parallel on other services, the higher the probability that the latter has caused the anomaly observed on the former.”
Proceedings of the 11th International Conference on Service-Oriented Computing (ICSOC 2013)
Basu, S., Pautasso, C., Zhang, L., & Fu, X. (2013) · International Conference on Service Oriented Computing · Cited by 44
Wang, Z., Zhang, H., Chen, T.-H. P., & Wang, S. (2021) · ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE) · doi:10.1145/3468264.3468613 · Cited by 19 · cited 1×
“In service-oriented software engineering, a variety of monitoring data play an essential role in maintaining the stability and reliability of microservice systems, such as metrics, traces, alerts, and logs [5, 7, 22, 34, 49].”
BackgroundTransforming Monolithic Systems to a Microservices Architecture
Hamza, M. (2023) · ACM SIGSOFT Software Engineering Notes · doi:10.1145/3573074.3573091 · Cited by 10
Research works printed but not linked: 14
- Kota Dohi, Takashi Endo, Harsh Purohit, Ryo Tanabe, and Yohei Kawaguchi. 2021. Flow-based self-supervised density estimation for anomalous sound detection. In Proceedings of the ICASSP 2021–2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). IEEE, 336–340.
- Mostafa Farshchi, Jean-Guy Schneider, Ingo Weber, and John Grundy. 2015. Experience report: Anomaly detection of cloud application operations using log and cloud metric correlation analysis. In Proceedings of the 2015 IEEE 26th International Symposium on Software Reliability Engineering (ISSRE). IEEE, 24–34.
- Dan Hendrycks Mantas Mazeika and Thomas Dietterich. 2018. Deep anomaly detection with outlier exposure. arXiv:1812.04606. Retrieved from https://arxiv.org/abs/1812.04606 · arXiv
- Diederik P. Kingma and Jimmy Ba. 2014. Adam: A method for stochastic optimization. arXiv:1412.6980. Retrieved from https://arxiv.org/abs/1412.6980 · arXiv
- Diederik P. Kingma and Max Welling. 2013. Auto-encoding variational bayes. arXiv:1312.6114. Retrieved from https://arxiv.org/abs/1312.6114 · arXiv
- Cheryl Lee Tianyi Yang Zhuangbin Chen Yuxin Su and Michael R. Lyu. 2023. Eadro: An end-to-end troubleshooting framework for microservices on multi-source data. arXiv:2302.05092. Retrieved from https://arxiv.org/abs/2302.05092 · arXiv
- Dewei Liu, Chuan He, Xin Peng, Fan Lin, Chenxi Zhang, Shengfang Gong, Ziang Li, Jiayu Ou, and Zheshun Wu. 2021. MicroHECL: High-efficient root cause localization in large-scale microservice systems. In Proceedings of the 2021 IEEE/ACM 43rd International Conference on Software Engineering: Software Engineering in Practice (ICSE-SEIP). IEEE, 338–347.
- Ping Liu, Yu Chen, Xiaohui Nie, Jing Zhu, Shenglin Zhang, Kaixin Sui, Ming Zhang, and Dan Pei. 2019. Fluxrank: A widely-deployable framework to automatically localizing root cause machines for software service failure mitigation. In Proceedings of the 2019 IEEE 30th International Symposium on Software Reliability Engineering (ISSRE). IEEE, 35–46.
- Jian-Guang Lou, Qingwei Lin, Rui Ding, Qiang Fu, Dongmei Zhang, and Tao Xie. 2013. Software analytics for incident management of online services: An experience report. In Proceedings of the 2013 28th IEEE/ACM International Conference on Automated Software Engineering (ASE). IEEE, 475–485.
- Meng Ma, Weilan Lin, Disheng Pan, and Ping Wang. 2019. Ms-rank: Multi-metric and self-adaptive root cause diagnosis for microservice applications. In Proceedings of the 2019 IEEE International Conference on Web Services (ICWS). IEEE, 60–67.
- Sasho Nedelkoski, Jorge Cardoso, and Odej Kao. 2019. Anomaly detection from system tracing data using multimodal deep learning. In Proceedings of the 2019 IEEE 12th International Conference on Cloud Computing (CLOUD). IEEE, 179–186.
- Danilo Jimenez Rezende, Shakir Mohamed, and Daan Wierstra. 2014. Stochastic backpropagation and approximate inference in deep generative models. In Proceedings of the 31st International Conference on Machine Learning. PMLR, 1278–1286.
- Ping Wang, Jingmin Xu, Meng Ma, Weilan Lin, Disheng Pan, Yuan Wang, and Pengfei Chen. 2018. Cloudranger: Root cause identification for cloud native systems. In Proceedings of the 2018 18th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (CCGRID). IEEE, 492–502.
- Li Wu, Johan Tordsson, Jasmin Bogatinovski, Erik Elmroth, and Odej Kao. 2021. Microdiag: Fine-grained performance diagnosis for microservice systems. In Proceedings of the 2021 IEEE/ACM International Workshop on Cloud Intelligence (CloudIntelligence). IEEE, 31–36.
Cited by
No More Data Silos: Unified Microservice Failure Diagnosis With Temporal Knowledge Graph
Zhang, S., Zhao, Y., Xia, S., Wei, S., Sun, Y., Zhao, C., Ma, S., Kuang, J., Zhu, B., Pan, L., et al. (2024) · IEEE Transactions on Services Computing · doi:10.1109/tsc.2024.3489444 · Cited by 29
“HeMiRCA [36] utilizes Spearman correlation to localize hierarchical root causes.”
Hypothesize-Then-Verify: Speculative Root Cause Analysis for Microservices with Pathwise Parallelism
Zhang, L., Jia, T., Zhai, Y., Pan, L., Duan, C., He, M., Xiao, P., & Li, Y. (2026) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1145/3786582.3786803 · Cited by 17
Agentic Memory Enhanced Recursive Reasoning for Root Cause Localization in Microservices
Zhang, L.-Z., Jia, T., Zhai, Y.-P., Pan, L.-Y., Duan, C.-M., He, M.-H., Jia, M., & Li, Y. (2026) · SEIP@ICSE · doi:10.1145/3786583.3786853 · Cited by 16
Rethinking the Evaluation of Microservice RCA with a Fault Propagation-Aware Benchmark
Fang, A., Zhang, S., Yang, Y., Wu, H., Xu, J., Wang, X., Wang, R., Wang, M., Lu, Q., & He, P. (2026) · Proceedings of the ACM on software engineering. · doi:10.1145/3797100 · Cited by 16
Self-citationLarge language models for agentic NetOps and AIOps: Architectures, evaluation, and safety
Bilal, M., Crowcroft, J., Wang, R., Xu, X., & Dustdar, S. (2027) · Computer Science Review · doi:10.1016/j.cosrev.2026.101075 · Cited by 10
“…engines, and telemetry queries [9], [10], [86] Evidence trace E ; hypothesis set H ; RCA evidence pointers; contradiction checks [10], [58], [59], [103] Citation to tool outputs; stop rules; escalation policy; no unsupervised write execution [10], [67], [74] RCA report; audit-ready trace of…”
Influential
Metadata
- Authors
- Zhu, Z., Lee, C., Tang, X., & He, P.
- Affiliations
- Chinese University of Hong Kong, Shenzhen (CN)
- Chinese University of Hong Kong (HK)
- Shenzhen Research Institute of Big Data (CN)
- Venue
- ACM Transactions on Software Engineering and Methodology
- Published
- 2024-11-21
- Volume
- 33
- Issue
- 8
- Pages
- 1-25
- ISSN
- 1049-331X (ISSN-L)
- 1557-7392
- OpenAlex
- W4400212265
- Cited by
- 26
- References
- 39
- Citations by year
- 2026: 18 · 2025: 7 · 2024: 1
- FWCI
- 4.34
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- ACM Transactions on Software Engineering and Methodology (publishedVersion)
- Funders
- National Natural Science Foundation of China (62102340)
- Guangdong Basic and Applied Basic Research Foundation (2024A1515010145)
- Topics
- Physical Sciences › Computer Science › Computer Networks and Communications › Software System Performance and Reliability
- Physical Sciences › Computer Science › Information Systems › Software Engineering Research
- Physical Sciences › Computer Science › Information Systems › Cloud Computing and Resource Management
- Keywords
- root cause analysis, microservices, anomaly detection, Spearman correlation, system reliability
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.