CauseInfer: Automatic and distributed performance diagnosis with hierarchical causality graph in large distributed systems
The DOI matches its Crossref record; 3 of the 3 references it cites were found in a registry or an index.
Abstract
Modern applications especially cloud-based or cloud-centric applications always have many components running in the large distributed environment with complex interactions. They are vulnerable to suffer from performance or availability problems due to the highly dynamic runtime environment such as resource hogs, configuration changes and software bugs. In order to make efficient software maintenance and provide some hints to software bugs, we build a system named CauseInfer, a low cost and blackbox cause inference system without instrumenting the application source code. CauseInfer can automatically construct a two layered hierarchical causality graph and infer the causes of performance problems along the causal paths in the graph with a series of statistical methods. According to the experimental evaluation in the controlled environment, we find out CauseInfer can achieve an average 80% precision and 85% recall in a list of top two causes to identify the root causes, higher than several state-of-the-art methods and a good scalability to scale up in the distributed systems.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Causality: Models, Reasoning, and Inference
Pearl, J. (2009) · doi:10.1017/cbo9780511803161 · Cited by 11,653
Causation, Prediction, and Search
Spirtes, P., Glymour, C., & Scheines, R. (2001) · doi:10.7551/mitpress/1754.001.0001 · Cited by 4,521
Detecting large-scale system problems by mining console logs
Xu, W., Huang, L., Fox, A., Patterson, D., & Jordan, M. I. (2009) · Proceedings of the ACM SIGOPS 22nd symposium on Operating systems principles · doi:10.1145/1629575.1629587 · Cited by 1,332
Cited by
Soldani, J., & Brogi, A. (2023) · ACM Computing Surveys · doi:10.1145/3501297 · Cited by 256
“Whenever the performance of the application frontend violates the application SLOs, CauseInfer [18, 19] and Microscope [25, 42] consider the whole application as affected by a performance anomaly.”
BackgroundMethodInfluentialMicroHECL: High-Efficient Root Cause Localization in Large-Scale Microservice Systems
Liu, D., He, C., Peng, X., Lin, F., Zhang, C., Gong, S., Li, Z., Ou, J., & Wu, Z. (2021) · 2021 IEEE/ACM 43rd International Conference on Software Engineering: Software Engineering in Practice (ICSE-SEIP) · doi:10.1109/icse-seip52600.2021.00043 · Cited by 192
Yu, G., Chen, P., Chen, H., Guan, Z., Huang, Z., Jing, L., Weng, T., Sun, X., & Li, X. (2021) · Proceedings of the Web Conference 2021 · doi:10.1145/3442381.3449905 · Cited by 158
Self-citationYu, G., Chen, P., Li, Y., Chen, H., Li, X., & Zheng, Z. (2023) · Proceedings of the 31st ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering · doi:10.1145/3611643.3616249 · Cited by 140
Self-citationQiu, J., Du, Q., Yin, K., Zhang, S.-L., & Qian, C. (2020) · Applied Sciences · doi:10.3390/app10062166 · Cited by 96
“In the RCA research for cloud applications, the most representative are related studies from Chen et al. [16–19], Nie et al. [20], Lin et al. [21], and Asai et al. [22].”
MethodMicroDiag: Fine-grained Performance Diagnosis for Microservice Systems
Wu, L., Tordsson, J., Bogatinovski, J., Elmroth, E., & Kao, O. (2021) · 2021 IEEE/ACM International Workshop on Cloud Intelligence (CloudIntelligence) · doi:10.1109/cloudintelligence52565.2021.00015 · Cited by 72
Mining causality of network events in log data
Kobayashi, S., Otomo, K., Fukuda, K., & Esaki, H. (2018) · IEEE Transactions on Network and Service Management · doi:10.1109/tnsm.2017.2778096 · Cited by 63
Failure Diagnosis in Microservice Systems: A Comprehensive Survey and Analysis
Zhang, S., Xia, S., Fan, W., Shi, B., Xiong, X., Zhong, Z., Ma, M., Sun, Y., & Pei, D. (2026) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3715005 · Cited by 57
Jin, M., Lv, A., Zhu, Y., Wen, Z., Zhong, Y., Zhao, Z., Wu, J., Li, H., He, H., & Chen, F. (2020) · IEEE Access · doi:10.1109/access.2020.3044610 · Cited by 50
Yu, G., Huang, Z., & Chen, P. (2023) · Journal of Software: Evolution and Process · doi:10.1002/smr.2413 · Cited by 44
Self-citationFaster, deeper, easier: crowdsourcing diagnosis of microservice kernel failure from user space
Pan, Y., Ma, M., Jiang, X., & Wang, P. (2021) · Proceedings of the 30th ACM SIGSOFT International Symposium on Software Testing and Analysis · doi:10.1145/3460319.3464805 · Cited by 42
“Previous diagnostic methods [7, 14, 15, 17, 18, 22, 29, 32, 33] either assume a static correlation within a given interval or use static causal discovery algorithms to build the dependencies [13].”
BackgroundMethodLogDC: Problem Diagnosis for Declartively-Deployed Cloud Applications with Log
Xu, J., Chen, P., Yang, L., Meng, F., & Wang, P. (2017) · 2017 IEEE 14th International Conference on e-Business Engineering (ICEBE) · doi:10.1109/icebe.2017.52 · Cited by 39
“From this figure, we observe that Precision and Recall of most kinds of deployments stay above 80%.”
MethodSelf-citationRoot Cause Analysis for Microservice System based on Causal Inference: How Far Are We?
Pham, L., Ha, H., & Zhang, H. (2024) · Proceedings of the 39th IEEE/ACM International Conference on Automated Software Engineering · doi:10.1145/3691620.3695065 · Cited by 38
Chen, H., Chen, P., & Yu, G. (2020) · IEEE Access · doi:10.1109/access.2020.2977464 · Cited by 36
Self-citationAnomaly Detection in Microservice-Based Systems
Nobre, J., Pires, E. J. S., & Reis, A. (2023) · Applied Sciences · doi:10.3390/app13137891 · Cited by 34
HeMiRCA: fine-grained root cause analysis for microservices with heterogeneous data sources
Zhu, Z., Lee, C., Tang, X., & He, P. (2024) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3674726 · Cited by 26
“Chen et al. , proposed CauseInfer, which constructed a two-layered hierarchical causal graph of the distributed system [6].”
BackgroundYao, Z., Pei, C., Chen, W., Wang, H., Su, L., Jiang, H., Xie, Z., Nie, X., & Pei, D. (2024) · Companion Proceedings of the 32nd ACM International Conference on the Foundations of Software Engineering · doi:10.1145/3663529.3663827 · Cited by 21
“However, a significant limitation of most prior research is the underutilization of diverse data types [4, 7, 12, 17–19, 27, 28, 36– 38, 41], as illustrated in Table 1.”
BackgroundMethodInfluentialXing, S., Wang, Y., & Liu, W. (2025) · Sensors · doi:10.3390/s25113396 · Cited by 23
“Traditional approaches rely on expert knowledge and rule-based systems [30], which become increasingly impractical as system complexity grows.”
MRCA: metric-level root cause analysis for microservices via multi-modal data
Wang, Y., Zhu, Z., Fu, Q., Ma, Y., & He, P. (2024) · Proceedings of the 39th IEEE/ACM International Conference on Automated Software Engineering · doi:10.1145/3691620.3695485 · Cited by 18
“Metric-based RCA usually involves directly analyzing correlations ( e.g. Pearson correlation coefficient) between services, or constructing causal graphs to pinpoint the root cause [6, 19, 23].”
T-Rank:A Lightweight Spectrum based Fault Localization Approach for Microservice Systems
Ye, Z., Chen, P., & Yu, G. (2021) · 2021 IEEE/ACM 21st International Symposium on Cluster, Cloud and Internet Computing (CCGrid) · doi:10.1109/ccgrid51090.2021.00051 · Cited by 19
Self-citationHolistic Root Cause Analysis for Failures in Cloud-Native Systems Through Observability Data
Han, Y., Du, Q., Huang, Y., Li, P., Shi, X., Wu, J., Fang, P., Tian, F., & He, C. (2024) · IEEE Transactions on Services Computing · doi:10.1109/tsc.2024.3478759 · Cited by 16
“Many approaches rely on single-modal data, including approaches based on traces [7], [8], [9], [10], [11], logs [12], [13], [14], [15], [16], [17], [18], and metrics [19], [20], 1939-1374 © 2024 IEEE.”
DyCause: Crowdsourcing to Diagnose Microservice Kernel Failure
Pan, Y., Ma, M., Jiang, X., & Wang, P. (2023) · IEEE Transactions on Dependable and Secure Computing · doi:10.1109/tdsc.2022.3233915 · Cited by 11
An empirical study on change-induced incidents of online service systems
Wu, Y., Chai, B., Li, Y., Liu, B., Li, J., Yang, Y., & Jiang, W. (2023) · 2023 IEEE/ACM 45th International Conference on Software Engineering: Software Engineering in Practice (ICSE-SEIP) · doi:10.1109/icse-seip58684.2023.00027 · Cited by 11
“Though root cause localization has been extensively studied in the literature [32]–[34].”
BackgroundMFRL-CA: Microservice Fault Root Cause Location based on Correlation Analysis
Chen, Y., Chen, N., Xu, W., Lian, L., & Tu, H. (2021) · 2021 8th International Conference on Dependable Systems and Their Applications (DSA) · doi:10.1109/dsa52907.2021.00018 · Cited by 9
Metadata
- Authors
- Chen, P., Qi, Y., Zheng, P., & Hou, D.
- Venue
- IEEE INFOCOM 2014 - IEEE Conference on Computer Communications
- Publisher
- IEEE
- Published
- 2014-04
- Pages
- 1887-1895
- OpenAlex
- W2028604378
- Cited by
- 140
- References
- 3
- FWCI
- 3.65
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.