Nezha: Interpretable Fine-Grained Root Causes Analysis for Microservices on Multi-modal Observability Data
The DOI matches its Crossref record; 46 of the 46 references it cites were found in a registry or an index.
Abstract
Root cause analysis (RCA) in large-scale microservice systems is a critical and challenging task. To understand and localize root causes of unexpected faults, modern observability tools collect and preserve multi-modal observability data, including metrics, traces, and logs. Since system faults may manifest as anomalies in different data sources, existing RCA approaches that rely on single-modal data are constrained in the granularity and interpretability of root causes. In this study, we present Nezha, an interpretable and fine-grained RCA approach that pinpoints root causes at the code region and resource type level by incorporative analysis of multi-modal data. Nezha transforms heterogeneous multi-modal data into a homogeneous event representation and extracts event patterns by constructing and mining event graphs. The core idea of Nezha is to compare event patterns in the fault-free phase with those in the fault-suffering phase to localize root causes in an interpretable way. Practical implementation and experimental evaluations on two microservice applications show that Nezha achieves a high top1 accuracy (89.77%) on average at the code region and resource type level and outperforms state-of-the-art approaches by a large margin. Two ablation studies further confirm the contributions of incorporating multi-modal data.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Nezha [37] jointly encodes metrics, logs, and traces into a shared space with contrastive alignment and performs graph-based reasoning to localize causally relevant services under noisy/partial observability.”
From TopoEvo: A Topology-Aware Self-Evolving Multi-Agent Framework for Root Cause Analysis in Microservices (2026) · cites this paper as [37]
Citations
Cites
USAD: UnSupervised Anomaly Detection on Multivariate Time Series
Audibert, J., Michiardi, P., Guyard, F., Marti, S., & Zuluaga, M. A. (2020) · Proceedings of the 26th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining · doi:10.1145/3394486.3403392 · Cited by 1,094 · cited 4×
“, USAD [2] and JumpStarter [43]) and monitor additional metrics beyond the P90 latency and success ratio to avoid missing faults.”
BackgroundInfluentialDrain: an online log parsing approach with fixed depth tree
He, P., Zhu, J., Zheng, Z., & Lyu, M. R. (2017) · 2017 IEEE International Conference on Web Services (ICWS) · doi:10.1109/icws.2017.13 · Cited by 943 · cited 2×
“Data Integrator adopts a state-of-the-art log parsing approach Drain [19] to extract the static log templates and dynamic log parameters from the raw log messages in a streaming manner.”
MethodSelf-citationVisualization of test information to assist fault localization
Jones, J. A., Harrold, M. J., & Stasko, J. (2002) · Proceedings/Proceedings - International Conference on Software Engineering · doi:10.1145/581339.581397 · Cited by 904
Log clustering based problem identification for online service systems
Lin, Q., Zhang, H., Lou, J.-G., Zhang, Y., & Chen, X. (2016) · Proceedings of the 38th International Conference on Software Engineering Companion · doi:10.1145/2889160.2889232 · Cited by 427
Zhou, X., Peng, X., Xie, T., Sun, J., Ji, C., Li, W., & Ding, D. (2021) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2018.2887384 · Cited by 410 · cited 3×
“The complexity of fault scenarios is alleviated by injecting resource issues and code defects from real faults in industrial systems [33, 76] into microservices.”
BackgroundResultMicroRCA: Root Cause Localization of Performance Issues in Microservices
Wu, L., Tordsson, J., Elmroth, E., & Kao, O. (2020) · NOMS 2020 - 2020 IEEE/IFIP Network Operations and Management Symposium · doi:10.1109/noms47738.2020.9110353 · Cited by 265
Unsupervised Detection of Microservice Trace Anomalies through Service-Level Deep Bayesian Networks
Liu, P., Xu, H., Ouyang, Q., Jiao, R., Chen, Z., Zhang, S., Yang, J., Mo, L., Zeng, J., Xue, W., et al. (2020) · 2020 IEEE 31st International Symposium on Software Reliability Engineering (ISSRE) · doi:10.1109/issre5003.2020.00014 · Cited by 252 · cited 5×
“We use fault injection to mimic application issues following the previous work [35, 37, 42, 68, 72, 73].”
MethodResultInfluentialDeepTraLog: trace-log combined microservice anomaly detection through graph-based deep learning
Zhang, C., Peng, X., Sha, C., Zhang, K., Fu, Z., Wu, X., Lin, Q., & Zhang, D. (2022) · Proceedings of the 44th International Conference on Software Engineering · doi:10.1145/3510003.3510180 · Cited by 207
Root Cause Analysis: A Tool for Total Quality Management
Wilson, P. F., Dell, L. D., & Anderson, G. F. (1996) · Journal For Healthcare Quality · doi:10.1111/j.1945-1474.1996.tb00823.x · Cited by 204
Identifying impactful service system problems via log analysis
He, S., Lin, Q., Lou, J.-G., Zhang, H., Lyu, M. R., & Zhang, D. (2018) · Proceedings of the 2018 26th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering · doi:10.1145/3236024.3236083 · Cited by 201
Detailed diagnosis in enterprise networks
Kandula, S., Mahajan, R., Verkaik, P., Agarwal, S., Padhye, J., & Bahl, P. (2009) · Proceedings of the ACM SIGCOMM 2009 conference on Data communication · doi:10.1145/1592568.1592597 · Cited by 194
Microscope: Pinpoint Performance Issues with Causal Graphs in Micro-service Environments
Lin, J., Chen, P., & Zheng, Z. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-03596-9_1 · Cited by 192
Self-citationCloudRanger: Root Cause Identification for Cloud Native Systems
Wang, P., Xu, J., Ma, M., Lin, W., Pan, D., Wang, Y., & Chen, P. (2018) · 2018 18th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (CCGRID) · doi:10.1109/ccgrid.2018.00076 · Cited by 181 · cited 2×
“Over the years, many metrics-based approaches [6, 26, 35, 62, 64, 65], trace-based approaches [8, 9, 13, 22, 32, 67, 68, 71], and log-based approaches [3, 20, 36, 45, 52, 56] have been devoted to au-”
BackgroundSelf-citationSage: practical and scalable ML-driven performance debugging in microservices
Gan, Y., Liang, M., Dev, S., Lo, D., & Delimitrou, C. (2021) · Proceedings of the 26th ACM International Conference on Architectural Support for Programming Languages and Operating Systems · doi:10.1145/3445814.3446700 · Cited by 174
Practical Root Cause Localization for Microservice Systems via Trace Analysis
Li, Z., Chen, J., Jiao, R., Zhao, N., Wang, Z., Zhang, S., Wu, Y., Jiang, L., Yan, L., Wang, Z., et al. (2021) · 2021 IEEE/ACM 29th International Symposium on Quality of Service (IWQOS) · doi:10.1109/iwqos52092.2021.9521340 · Cited by 159
Yu, G., Chen, P., Chen, H., Guan, Z., Huang, Z., Jing, L., Weng, T., Sun, X., & Li, X. (2021) · Proceedings of the Web Conference 2021 · doi:10.1145/3442381.3449905 · Cited by 158
Self-citationChen, P., Qi, Y., Zheng, P., & Hou, D. (2014) · IEEE INFOCOM 2014 - IEEE Conference on Computer Communications · doi:10.1109/infocom.2014.6848128 · Cited by 140
Self-citationGraph-based trace analysis for microservice architecture understanding and problem diagnosis
Guo, X., Peng, X., Wang, H., Li, W., Jiang, H., Ding, D., Xie, T., & Su, L. (2020) · Proceedings of the 28th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering · doi:10.1145/3368089.3417066 · Cited by 118 · cited 2×
“Compared with PDiagnose [18] that transforms heterogeneous multi-modal data as time series, Nezha retains the execution context of requests when transforming multi-modal data as homogeneous events, which allows for improved interpretability in RCA.”
MethodMicroscaler: Automatic Scaling for Microservices with an Online Learning Approach
Yu, G., Chen, P., & Zheng, Z. (2019) · 2019 IEEE International Conference on Web Services (ICWS) · doi:10.1109/icws.2019.00023 · Cited by 97
Self-citationGroot: An Event-graph-based Approach for Root Cause Analysis in Industrial Settings
Wang, H., Wu, Z., Jiang, H., Huang, Y., Wang, J., Kopru, S., & Xie, T. (2021) · 2021 36th IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1109/ase51524.2021.9678708 · Cited by 92
Identifying bad software changes via multimodal anomaly detection for online service systems
Zhao, N., Chen, J., Yu, Z., Wang, H., Li, J., Qiu, B., Xu, H., Zhang, W., Sui, K., & Pei, D. (2021) · Proceedings of the 29th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering · doi:10.1145/3468264.3468543 · Cited by 89
CloudRCA: A Root Cause Analysis Framework for Cloud Computing Platforms
Zhang, Y., Guan, Z., Qian, H., Xu, L., Liu, H., Wen, Q., Sun, L., Jiang, J., Fan, L., & Ke, M. (2021) · Proceedings of the 30th ACM International Conference on Information & Knowledge Management · doi:10.1145/3459637.3481903 · Cited by 84
Mining Historical Test Logs to Predict Bugs and Localize Faults in the Test Logs
Amar, A., & Rigby, P. C. (2019) · 2019 IEEE/ACM 41st International Conference on Software Engineering (ICSE) · doi:10.1109/icse.2019.00031 · Cited by 73
MicroDiag: Fine-grained Performance Diagnosis for Microservice Systems
Wu, L., Tordsson, J., Bogatinovski, J., Elmroth, E., & Kao, O. (2021) · 2021 IEEE/ACM International Workshop on Cloud Intelligence (CloudIntelligence) · doi:10.1109/cloudintelligence52565.2021.00015 · Cited by 72
Actionable and interpretable fault localization for recurring failures in online service systems
Li, Z., Zhao, N., Li, M., Lu, X., Wang, L., Chang, D., Nie, X., Cao, L., Zhang, W., Sui, K., et al. (2022) · Proceedings of the 30th ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering · doi:10.1145/3540250.3549092 · Cited by 70
Diagnosing Performance Issues in Microservices with Heterogeneous Data Source
Hou, C., Jia, T., Wu, Y., Li, Y., & Han, J. (2021) · 2021 IEEE Intl Conf on Parallel & Distributed Processing with Applications, Big Data & Cloud Computing, Sustainable Computing & Communications, Social Computing & Networking (ISPA/BDCloud/SocialCom/SustainCom) · doi:10.1109/ispa-bdcloud-socialcom-sustaincom52081.2021.00074 · Cited by 54
Self-citationDigging deeper into cluster system logs for failure prediction and root cause diagnosis
Fu, X., Ren, R., McKee, S. A., Zhan, J., & Sun, N. (2014) · IEEE International Conference on Cluster Computing (CLUSTER) · doi:10.1109/cluster.2014.6968768 · Cited by 47
Deep Attentive Anomaly Detection for Microservice Systems with Multimodal Time-Series Data
Chen, Y., Yan, M. L., Yang, D., Zhang, X., & Wang, Z. (2022) · IEEE International Conference on Web Services (ICWS) · doi:10.1109/icws55610.2022.00062 · Cited by 46
DeCaf: diagnosing and triaging performance issues in large-scale cloud services
Bansal, C., Renganathan, S., Asudani, A., Midy, O., & Janakiraman, M. (2020) · Proceedings of the ACM/IEEE 42nd International Conference on Software Engineering: Software Engineering in Practice · doi:10.1145/3377813.3381353 · Cited by 44
Yu, G., Huang, Z., & Chen, P. (2023) · Journal of Software: Evolution and Process · doi:10.1002/smr.2413 · Cited by 44 · cited 5×
“MicroRank [68] and TraceRank [71] combine PageRank and spectrum algorithms to distinguish two different microservices with similar coverage.”
BackgroundMethodInfluentialSelf-citationFaster, deeper, easier: crowdsourcing diagnosis of microservice kernel failure from user space
Pan, Y., Ma, M., Jiang, X., & Wang, P. (2021) · Proceedings of the 30th ACM SIGSOFT International Symposium on Software Testing and Analysis · doi:10.1145/3460319.3464805 · Cited by 42 · cited 1×
“Over the years, many metrics-based approaches [6, 26, 35, 62, 64, 65], trace-based approaches [8, 9, 13, 22, 32, 67, 68, 71], and log-based approaches [3, 20, 36, 45, 52, 56] have been devoted to au-”
BackgroundDARC: dynamic analysis of root causes of latency distributions
Traeger, A., Deras, I., & Zadok, E. (2008) · Proceedings of the 2008 ACM SIGMETRICS international conference on Measurement and modeling of computer systems · doi:10.1145/1375457.1375489 · Cited by 39
Huang, L., & Zhu, T. (2021) · Proceedings of the ACM Symposium on Cloud Computing · doi:10.1145/3472883.3486994 · Cited by 37 · cited 1×
“Over the years, many metrics-based approaches [6, 26, 35, 62, 64, 65], trace-based approaches [8, 9, 13, 22, 32, 67, 68, 71], and log-based approaches [3, 20, 36, 45, 52, 56] have been devoted to au-”
BackgroundTraceCRL: contrastive representation learning for microservice trace analysis
Zhang, C., Peng, X., Zhou, T., Sha, C., Yan, Z., Chen, Y., & Yang, H. (2022) · Proceedings of the 30th ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering · doi:10.1145/3540250.3549146 · Cited by 36
LogReducer: Identify and Reduce Log Hotspots in Kernel on the Fly
Yu, G., Chen, P., Li, P., Weng, T., Zheng, H., Deng, Y., & Zheng, Z. (2023) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1109/icse48619.2023.00151 · Cited by 35
Self-citationFast Dimensional Analysis for Root Cause Investigation in a Large-Scale Service Environment
Lin, F., Muzumdar, K., Laptev, N. P., Curelea, M.-V., Lee, S., & Sankar, S. (2020) · Proceedings of the ACM on Measurement and Analysis of Computing Systems · doi:10.1145/3392149 · Cited by 33
Towards Automated Inter-Service Authorization for Microservice Applications
Li, X., Chen, Y., & Lin, Z. (2019) · ACM SIGCOMM Conference Posters and Demos · doi:10.1145/3342280.3342288 · Cited by 29
Self-citationGoing through the Life Cycle of Faults in Clouds: Guidelines on Fault Handling
Li, X., Yu, G., Chen, P., Chen, H., & Chen, Z. (2022) · Proceedings/Proceedings - International Symposium on Software Reliability Engineering · doi:10.1109/issre55969.2022.00022 · Cited by 26
Self-citationRosenberg, C. M., & Moonen, L. (2020) · Proceedings of the ... ACM-IEEE International Symposium on Empirical Software Engineering and Measurement/International Symposium on Empirical Software Engineering and Measurement · doi:10.1145/3382494.3410684 · Cited by 23
Li, Y., Yu, G., Chen, P., Zhang, C., & Zheng, Z. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-20984-0_15 · Cited by 23
Self-citationSieve: Attention-based Sampling of End-to-End Trace Data in Distributed Microservice Systems
Huang, Z., Chen, P., Yu, G., Chen, H., & Zheng, Z. (2021) · 2021 IEEE International Conference on Web Services (ICWS) · doi:10.1109/icws53863.2021.00063 · Cited by 22 · cited 1×
“Microservice architecture decomposes an application into many small pieces of services, allowing developers to modify and redeploy specific services rather than the entire application [23, 70].”
BackgroundSelf-citationScalable Statistical Root Cause Analysis on App Telemetry
Murali, V., Yao, E., Mathur, U., & Chandra, S. (2021) · IEEE/ACM International Conference on Software Engineering: Software Engineering in Practice (ICSE-SEIP) · doi:10.1109/icse-seip52600.2021.00038 · Cited by 21
Diagnosing Performance Variations by Comparing Multi-Level Execution Traces
Doray, F., & Dagenais, M. (2016) · IEEE Transactions on Parallel and Distributed Systems · doi:10.1109/tpds.2016.2567390 · Cited by 19
T-Rank:A Lightweight Spectrum based Fault Localization Approach for Microservice Systems
Ye, Z., Chen, P., & Yu, G. (2021) · 2021 IEEE/ACM 21st International Symposium on Cluster, Cloud and Internet Computing (CCGrid) · doi:10.1109/ccgrid51090.2021.00051 · Cited by 19
Self-citationYamada, H., & Nemoto, J. (2022) · Proceedings of the VLDB Endowment · doi:10.14778/3523210.3523212 · Cited by 9
Yu, G., Chen, P., Yufeng, L. I., Chen, H., Li, X., & Zheng, Z. (2023) · Zenodo (CERN European Organization for Nuclear Research) · doi:10.5281/zenodo.8276374 · Cited by 1
Self-citation
Research works printed but not linked: 8
- Michael Chow, David Meisner, Jason Flinn, Daniel Peek, and Thomas F. Wenisch. 2014. The Mystery Machine: End-to-end Performance Analysis of Large-scale Internet Services. In OSDI 2014. USENIX Association, 217–231.
- Rodrigo Fonseca, George Porter, Randy H. Katz, Scott Shenker, and Ion Stoica. 2007. X-Trace: A Pervasive Network Tracing Framework. In NSDI, 2007. USENIX, 271–284.
- Chang Lou, Peng Huang, and Scott Smith. 2020. Understanding, Detecting and Localizing Partial Failures in Large System Software. In NSDI 2020. USENIX Association, 559–574.
- Minghua Ma, Shenglin Zhang, Junjie Chen, Jim Xu, Haozhe Li, Yongliang Lin, Xiaohui Nie, Bo Zhou, Yong Wang, and Dan Pei. 2021. Jump-Starting Multivariate Time Series Anomaly Detection for Online Service Systems. In USENIX ATC 2021. USENIX Association, 413–426.
- Karthik Nagaraj, Charles Edwin Killian, and Jennifer Neville. 2012. Structured Comparative Analysis of Systems Logs to Diagnose Performance Problems. In NSDI 2012. USENIX Association, 353–366.
- Opentelemetry. 2023. Opentelemetry. https://opentelemetry.io Accessed Jan. 6, 2023
- Benjamin H Sigelman, Luiz Andre Barroso, Mike Burrows, Pat Stephenson, Manoj Plakal, Donald Beaver, Saul Jaspan, and Chandan Shanbhag. 2010. Dapper, a large-scale distributed systems tracing infrastructure.
- Apache SkyWalking. 2023. Apache SkyWalking. https://skywalking.apache.org Accessed Jan. 6, 2023
Cited by
Failure Diagnosis in Microservice Systems: A Comprehensive Survey and Analysis
Zhang, S., Xia, S., Fan, W., Shi, B., Xiong, X., Zhong, Z., Ma, M., Sun, Y., & Pei, D. (2026) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3715005 · Cited by 57
MULAN: Multi-modal Causal Structure Learning and Root Cause Analysis for Microservice Systems
Zheng, L., Chen, Z., He, J., & Chen, H. (2024) · International World Wide Web Conference (WWW) · doi:10.1145/3589334.3645442 · Cited by 130
“Train Ticket [51]: This dataset is a microservice system for railway ticketing service with 5 system faults.”
BackgroundMethodInfluentialSelf-citationChen, S., Long, X., Fan, J., & Jin, G. (2025) · Reliability Engineering & System Safety · doi:10.1016/j.ress.2025.111520 · Cited by 66
Interpretable Failure Localization for Microservice Systems Based on Graph Autoencoder
Sun, Y., Lin, Z., Shi, B., Zhang, S., Ma, S., Jin, P., Zhong, Z., Pan, L., Guo, Y., & Pei, D. (2025) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3695999 · Cited by 62
Faseeha, U., Syed, H. J., Samad, F., Zehra, S., & Ahmed, H. M. (2025) · IEEE Access · doi:10.1109/access.2025.3562125 · Cited by 74
“Frameworks like MDF [65], Metrofunnel [66], AET [68], SuanMing [69], BBMA [70], Nezha [71], KUNERVA [72], CDOF [73], ADOB [74], eBPFM [75], MSM [78], STEAM [80], CHAOSORCA [82], eBPFNM [83], and ADAM [90] support deployment in cloud environments.”
Influential
Metadata
- Authors
- Yu, G., Chen, P., Li, Y., Chen, H., Li, X., & Zheng, Z.
- Affiliations
- Sun Yat-sen University (CN)
- Venue
- Proceedings of the 31st ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering
- Publisher
- ACM
- Published
- 2023-11-30
- Pages
- 553-565
- OpenAlex
- W4389158453
- Cited by
- 140
- References
- 46
- Citations by year
- 2026: 59 · 2025: 58 · 2024: 23
- FWCI
- 42.18
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE) (publishedVersion)
- Funders
- National Key Research and Development Program of China (2019YFB1804002)
- National Natural Science Foundation of China (No.62272495)
- Guangdong Basic and Applied Basic Research Foundation (No.2023B1515020054)
- CCF-Lenovo Blue Ocean Research Fund
- Topics
- Physical Sciences › Computer Science › Computer Networks and Communications › Software System Performance and Reliability
- Physical Sciences › Computer Science › Software › Software Testing and Debugging Techniques
- Physical Sciences › Computer Science › Information Systems › Software Engineering Research
- Keywords
- root cause analysis, microservices, event graphs, fault location, interpretable fault diagnosis
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.