Fault Analysis and Debugging of Microservice Systems: Industrial Survey, Benchmark System, and Empirical Study
The DOI matches its Crossref record; 40 of the 42 references it cites were found in a registry or an index, and 1 are not checked yet.
Abstract
The complexity and dynamism of microservice systems pose unique challenges to a variety of software engineering tasks such as fault analysis and debugging. In spite of the prevalence and importance of microservices in industry, there is limited research on the fault analysis and debugging of microservice systems. To fill this gap, we conduct an industrial survey to learn typical faults of microservice systems, current practice of debugging, and the challenges faced by developers in practice. We then develop a medium-size benchmark microservice system (being the largest and most complex open source microservice system within our knowledge) and replicate 22 industrial fault cases on it. Based on the benchmark system and the replicated fault cases, we conduct an empirical study to investigate the effectiveness of existing industrial debugging practices and whether they can be further improved by introducing the state-of-the-art tracing and visualization techniques for distributed systems. The results show that the current industrial practices of microservice debugging can be improved by employing proper tracing and visualization techniques and strategies. Our findings also suggest that there is a strong need for more intelligent trace analysis and visualization, e.g., by combining trace visualization and improved fault localization, and employing data-driven and learning-based recommendation for guided visual exploration and comparison of traces.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Based on various testimonials [46], the debugging process is divided into seven phases: Initial Understanding (IU), Environment Setup (ES), Failure Reproduction (FR), Failure Identification (FI), Fault Scoping (FS), Fault Localization (FL), and Fault Fixing (FF).”
From Anomaly detection and root-cause identification in microservices: a survey (2026) · cites this paper as [46]
In the citing paper
“Research has focused on tasks such as anomaly detection [90, 237], incident classification [36, 68], and root cause analysis [228, 247].”
From A 2030 Roadmap for Software Engineering (2025) · cites this paper as [247]
Citations
Cites
Microservices: Yesterday, Today, and Tomorrow
Dragoni, N., Giallorenzo, S., Lafuente, A. L., Mazzara, M., Montesi, F., Mustafin, R., & Safina, L. (2017) · Springer eBooks · doi:10.1007/978-3-319-67425-4_12 · Cited by 2,058
A Survey on Software Fault Localization
Wong, W. E., Gao, R., Li, Y., Abreu, R., & Wotawa, F. (2016) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2016.2521368 · Cited by 1,110 · cited 1×
“In addition, existing fault localization techniques [36] are ineffective for microservices.”
Simplifying and isolating failure-inducing input
Zeller, A., & Hildebrandt, R. (2002) · IEEE Transactions on Software Engineering · doi:10.1109/32.988498 · Cited by 1,079 · cited 2×
“, spectrum-based fault localization [38] and delta debugging [56]) for microservice debugging.”
Scalable statistical bug isolation
Liblit, B., Naik, M., Zheng, A. X., Aiken, A., & Jordan, M. I. (2005) · ACM SIGPLAN Notices · doi:10.1145/1064978.1065014 · Cited by 729
Microservices: The Journey So Far and Challenges Ahead
Jamshidi, P., Pahl, C., Mendonca, N. C., Lewis, J., & Tilkov, S. (2018) · IEEE Software · doi:10.1109/ms.2018.2141039 · Cited by 554 · cited 1×
“There have been appeals that practitioners and researchers develop and share a common microservice infrastructure that can emulate the production environments of typical microservice applications for more repeatable and industry-focused empirical studies [23], [24].”
Using Mutation Analysis for Assessing and Comparing Testing Coverage Criteria
Andrews, J. H., Briand, L. C., Labiche, Y., & Namin, A. S. (2006) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2006.83 · Cited by 481 · cited 1×
“Similarly related fault localization techniques are designed mainly for sequential programs, such as statistic-based fault localization [39], and machine-learning-based ones [40], [41].”
Scalable statistical bug isolation
Liblit, B., Naik, M., Zheng, A. X., Aiken, A., & Jordan, M. I. (2005) · Proceedings of the 2005 ACM SIGPLAN conference on Programming language design and implementation · doi:10.1145/1065010.1065014 · Cited by 472 · cited 1×
“Similarly related fault localization techniques are designed mainly for sequential programs, such as statistic-based fault localization [39], and machine-learning-based ones [40], [41].”
Spectrum-Based Multiple Fault Localization
Abreu, R., Zoeteweij, P., & van Gemund, A. J. C. (2009) · 2009 IEEE/ACM International Conference on Automated Software Engineering · doi:10.1109/ase.2009.25 · Cited by 401 · cited 4×
“There has been some research on debugging concurrent programs [38], [59], [60] and distributed systems [10], [61], [62], [63].”
InfluentialA Systematic Mapping Study in Microservice Architecture
Alshuqayran, N., Ali, N., & Evans, R. (2016) · 2016 IEEE 9th International Conference on Service-Oriented Computing and Applications (SOCA) · doi:10.1109/soca.2016.15 · Cited by 399 · cited 1×
“[57] present a systematic mapping study on microservice architecture, focusing on the architec-”
Research on Architecting Microservices: Trends, Focus, and Potential for Industrial Adoption
Francesco, P. D., Malavolta, I., & Lago, P. (2017) · 2017 IEEE International Conference on Software Architecture (ICSA) · doi:10.1109/icsa.2017.24 · Cited by 311 · cited 3×
“[2] present a systematic mapping study on the current state of the art on architect-”
Research works printed but not linked: 2
- 10.1109/ecase.2017..4 · doi:10.1109/ecase.2017..4
- 10.1109/scc.2016.113 · DOI · Paper page
Cited by
Items 101–200 of 548
Software compliance in various industries using CI/CD, dynamic microservices, and containers
Dakić, P. (2024) · Open Computer Science · doi:10.1515/comp-2024-0013 · Cited by 27
Towards LLM-Assisted System Testing for Microservices
Almutawa, M., Ghabrah, Q., & Canini, M. (2024) · IEEE International Conference on Distributed Computing Systems Workshops (ICDCSW) · doi:10.1109/icdcsw63686.2024.00011 · Cited by 27
“As a result of this increased complexity, testing MSA-based applications can be a serious challenge to developers [6].”
BackgroundHeMiRCA: fine-grained root cause analysis for microservices with heterogeneous data sources
Zhu, Z., Lee, C., Tang, X., & He, P. (2024) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3674726 · Cited by 26
Alonso, J., Orue-Echevarria, L., & Huarte, M. (2022) · Applied Sciences · doi:10.3390/app12094347 · Cited by 26
Going through the Life Cycle of Faults in Clouds: Guidelines on Fault Handling
Li, X., Yu, G., Chen, P., Chen, H., & Chen, Z. (2022) · Proceedings/Proceedings - International Symposium on Software Reliability Engineering · doi:10.1109/issre55969.2022.00022 · Cited by 26
“Tracing [57]–[59] is particularly effective to handle such cases and attaches a “trace id” to a request so as to identify the whole execution path of the request among inter-components and intra-components.”
BackgroundChen, F., Zhang, L., & Lian, X. (2021) · Software Practice and Experience · doi:10.1002/spe.2967 · Cited by 26
“Zhou et al. 17 conduct an industrial survey to learn typical faults and current practice of microservice systems.”
BackgroundLogiAgent: Automated Logical Testing for REST Systems with LLM-Based Multi-AgentsPreprint
Zhang, K., Zhang, C., Wang, C., Zhang, C., Wu, Y., Xing, Z., Liu, Y., Li, Q., & Peng, X. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2503.15079 · Cited by 26
Self-citationDiagnosing Performance Issues for Large-Scale Microservice Systems With Heterogeneous Graph
Lei, T., Lu, X., Zhang, S., Luan, J., Li, Y., Li, M., Li, Z., Yu, Q., Xie, H., Xu, R., et al. (2024) · IEEE Transactions on Services Computing · doi:10.1109/tsc.2024.3402172 · Cited by 25
“2) Open-Source Microservice System: Train-Ticket [19] is a Web-based online ticket booking microservice system, containing 41 microservices.”
MethodInfluentialAdaptive Root Cause Localization for Microservice Systems with Multi-Agent Recursion-of-ThoughtPreprint
Zhang, L., Jia, T., Wang, K., Hong, W., Duan, C., He, M., & Li, Y. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2508.20370 · Cited by 25
“Modern microservice systems have become increasingly complex due to dynamic interactions and evolving runtime environments [1]–[3].”
Intelligent Root Cause Localization in MicroService Systems: A Survey and New Perspectives
Fu, N., Cheng, G., Teng, Y., Dai, G., Yu, S., & Chen, Z. (2025) · ACM Computing Surveys · doi:10.1145/3736755 · Cited by 26
“Zhou et al. [145] Summarizing typical faults of microservice systems, the practice of debugging, and the challenges.”
Wang, L., Jiang, Y. X., Wang, Z., Huo, Q. E., Dai, J., Xie, S. L., Li, R., Feng, M. T., Xu, Y. S., & Jiang, Z. P. (2022) · Journal of Software Evolution and Process · doi:10.1002/smr.2433 · Cited by 25
Localizing and Explaining Faults in Microservices Using Distributed Tracing
Ríos, J., Jha, S., & Shwartz, L. (2022) · IEEE ... International Conference on Cloud Computing · doi:10.1109/cloud55607.2022.00072 · Cited by 24
“However, current industry debugging practices do not seem to be at a level of maturity to meet this challenge [6].”
BackgroundUnderstanding and handling alert storm for online service systems
Zhao, N., Chen, J., Peng, X., Wang, H., Wu, X., Zhang, Y., Chen, Z., Zheng, X., Nie, X., Wang, G., et al. (2020) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1145/3377812.3390809 · Cited by 24
Self-citationCloud-OpsBench: A Reproducible Benchmark for Agentic Root Cause Analysis in Cloud SystemsPreprint
Wang, Y., Yu, G., Huang, H., Huang, Y., Wang, Z., Chen, P., & Lyu, M. R. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2603.00468 · Cited by 26
“The reliability of cloud-native systems constitutes the foundation of modern online services [54, 62].”
Xing, S., Wang, Y., & Liu, W. (2025) · Sensors · doi:10.3390/s25113396 · Cited by 23
“While this architectural paradigm offers significant advantages in terms of scalability, flexibility, and development efficiency, it also introduces substantial challenges for system monitoring, anomaly detection, and fault diagnosis [2].”
An Empirical Study on Challenges of Event Management in Microservice Architectures
Laigner, R., Almeida, A. C., Assunção, W. K. G., & Zhou, Y. (2025) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3776581 · Cited by 23
“1 There has been extensive work investigating the adoption and implications of microservice architectures [9, 34, 59, 68, 71, 89, 114, 118, 119, 127, 129].”
Zeng, R., Hou, X., Zhang, L., Li, C., Zheng, W., & Guo, M. (2022) · Frontiers of Computer Science · doi:10.1007/s11704-020-0072-3 · Cited by 23
“Table 2 Summary of Prior Works on Performance Evaluation and Monitoring Categories Subcategories Prior Work Benchmarking \ [53], [56], [57], [60], [54], [55],[58] System and Architecture Implications [61], [62], [63], [64]”
BackgroundLi, Y., Yu, G., Chen, P., Zhang, C., & Zheng, Z. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-20984-0_15 · Cited by 23
Automatic Analysis of Complex Interactions in Microservice Systems
Dai, F., Chen, H., Qiang, Z., Liang, Z., Huang, B., & Wang, L. (2020) · Complexity · doi:10.1155/2020/2128793 · Cited by 23
“-ese characteristics of microservice architecture are particularly suitable for losing coupling and updating systems running on cloud infrastructures [10].”
BackgroundInfluential(2024) · doi:10.1145/3597503.3639088 · Cited by 22
Self-citationAutomatically Building Service-Based Systems With Function Relaxation
Sun, L., Zhou, R. H., Peng, D., Bouguettaya, A., & Zhang, Y. (2022) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2022.3164767 · Cited by 22
Automated Detection of Software Performance Antipatterns in Java-Based Applications
Trubiani, C., Pinciroli, R., Biaggi, A., & Fontana, F. A. (2023) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2023.3234321 · Cited by 22
“To strengthen the analysis of the EST antipattern, we borrow the subject system used in [62].”
MethodFaaSter Troubleshooting - Evaluating Distributed Tracing Approaches for Serverless Applications
Borges, M. C., Werner, S., & Kilic, A. (2021) · IEEE International Conference on Cloud Engineering · doi:10.1109/ic2e52221.2021.00022 · Cited by 22
Zhang, W., Guo, H., Yang, J. X., Tian, Z., Zhang, Y., Yan, C., Li, Z., Li, T., Shi, X., Zheng, L., et al. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2404.12135 · Cited by 22
“User registration and login, ticket availability search, ticket booking, order status refresh, order payment, and ticket check-in.”
BackgroundDetecting Causal Structure on Cloud Application Microservices Using Granger Causality Models
Wang, Q., Shwartz, L., Grabarnik, G. Y., Arya, V., & Shanmugam, K. (2021) · IEEE ... International Conference on Cloud Computing · doi:10.1109/cloud53861.2021.00072 · Cited by 21
“Nowadays, more and more companies have migrated their business systems from the monolithic service architecture to microservices architecture (Figure 1 shows a benchmark microservice application called TrainTicket [38], [39]).”
BackgroundTowards a Fault Taxonomy for Microservices-Based Applications
Silva, F., Lelli, V., Santos, I. D. S., & Andrade, R. M. C. (2022) · Brazilian Symposium on Software Engineering · doi:10.1145/3555228.3555245 · Cited by 21
“, asynchronous processes [26]) that make the fault injection activity more complex.”
BackgroundLook Deep into the Microservice System Anomaly through Very Sparse Logs
Jiang, X., Pan, Y., Ma, M., & Wang, P. (2023) · International World Wide Web Conference (WWW) · doi:10.1145/3543507.3583338 · Cited by 21
“It allows us to develop web apps and refactor them quickly but also brings higher operational and maintenance difculties due to the structural complexity and dynamics [35].”
BackgroundSTEAM: Observability-Preserving Trace Sampling
He, S., Feng, B., Li, L., Zhang, X., Kang, Y., Lin, Q., Rajmohan, S., & Zhang, D. (2023) · ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE) · doi:10.1145/3611643.3613881 · Cited by 21
“The tremendouscomplexitymakesitexceedinglychallengingtocom-prehendsysteminternals,optimizeperformance,anddiagnose failures[7,35,48,49].”
MethodTracemesh: Scalable and Streaming Sampling for Distributed Traces
Chen, Z., Jiang, Z., Su, Y., Lyu, M. R.-T., & Zheng, Z. (2024) · IEEE ... International Conference on Cloud Computing · doi:10.1109/cloud62652.2024.00016 · Cited by 21
“The empirical study in [3] shows that the current industrial practices of microservice debugging can be improved through the application of appropriate tracing and visualization techniques.”
BackgroundMethodThe Tale of Errors in Microservices
Lee, I.-T. A., Zhang, Z., Parwal, A., & Chabbi, M. (2024) · Proceedings of the ACM on Measurement and Analysis of Computing Systems · doi:10.1145/3700436 · Cited by 21
Introducing Black-Box Fuzz Testing for REST APIs in Industry: Challenges and Solutions
Arcuri, A., Poth, A., & Rrjolli, O. (2025) · IEEE International Conference on Software Testing, Verification and Validation (ICST) · doi:10.1109/icst62969.2025.10988923 · Cited by 21
“These included topics such as unit testing [33], testing of embedded systems [34], user interface testing for ERP applications [35] and for mobile applications [36], [37], mutation testing [38], [39], fault debugging [40] and flaky tests [41].”
Evaluation of Causal Inference Techniques for AIOps
Arya, V., Shanmugam, K., Aggarwal, P., Wang, Q., Mohapatra, P., & Nagar, S. (2020) · Joint International Conference on Data Science & Management of Data (CODS-COMAD) · doi:10.1145/3430984.3431027 · Cited by 21
“…of 3 families of Granger causal inference techniques and their variants on a benchmark TrainTicket microservice system that is publicly available [34–36]: (a) PC algorithm based on independence tests and its variants (b) variants of regression based techniques, and (c) graphical event models [3,…”
MethodExplaining Microservices' Cascading Failures From Their Logs
Soldani, J., Forti, S., Roveroni, L., & Brogi, A. (2024) · Software Practice and Experience · doi:10.1002/spe.3400 · Cited by 20
“For instance, Guo et al. [41] and Zhou et al. [31] share our goal of both identifying the possible root cause for an observed failure and the failure cascades explaining why this was the case.”
Li, Y., Hu, H., Liu, W., & Yang, X. (2023) · Electronics · doi:10.3390/electronics12071598 · Cited by 20
Real-Time Anomaly Detection Using Distributed Tracing in Microservice Cloud Applications
Raeiszadeh, M., Ebrahimzadeh, A., Saleem, A., Glitho, R., Eker, J., & Mini, R. A. F. (2023) · IEEE International Conference on Cloud Networking · doi:10.1109/cloudnet59005.2023.10490038 · Cited by 20
“2) Benchmark Application: In our evaluations, we considered TrainTicket [6], which is a dynamic real-world mi-croservice benchmark.”
Zhang, L., Jia, T., Jia, M., Liu, H., Yang, Y., Wu, Z., & Li, Y. (2024) · IEEE Transactions on Services Computing · doi:10.1109/tsc.2024.3521675 · Cited by 20
“…and classifications of anomalies in state-of-art work and discover that storage system anomalies can be classified into two categories [9], [10], [11], [14], [21], [30], [31], [32], [33], [34]: (1) anomalies caused by the system resource and (2) anomalies generated by the storage system itself.”
SuanMing: Explainable Prediction of Performance Degradations in Microservice Applications
Grohmann, J., Straesser, M., Chalbani, A., Eismann, S., Arian, Y., Herbst, N. R., Peretz, N., & Kounev, S. (2021) · ACM/SPEC International Conference on Performance Engineering (ICPE) · doi:10.1145/3427921.3450248 · Cited by 20
Sarda, K., Namrud, Z., Litoiu, M., Shwartz, L., & Watts, I. (2024) · Companion Proceedings of the 32nd ACM International Conference on the Foundations of Software Engineering · doi:10.1145/3663529.3663855 · Cited by 19
“This transition streamlines deployment and scalability using shared environments and cloud-native technologies [91].”
Lifting the Fog of Uncertainties: Dynamic Resource Orchestration for the Containerized Cloud
Zhang, Y., Zhang, T., Zhang, G., & Jacobsen, H. (2023) · ACM Symposium on Cloud Computing (SoCC) · doi:10.1145/3620678.3624646 · Cited by 19
“The impact of cloud uncertainties can be even more serious for microservice applications, due to their complicated calling graphs and the resulting inter-container communication patterns [51, 84].”
BackgroundLi, J., Pang, G., Chen, L., & Namazi‐Rad, M. (2023) · IEEE International Conference on Data Science and Advanced Analytics (DSAA) · doi:10.1109/dsaa60987.2023.10302626 · Cited by 19
“TraceLog is a large-scale heterogeneous graph dataset derived from a train ticket-based microservice system [34] for booking training tickets.”
BackgroundMicroRemed: Benchmarking LLMs in Microservices RemediationPreprint
Zhang, L., Zhai, Y., Jia, T., Duan, C., He, M., Pan, L., Liu, Z., Ding, B., & Li, Y. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2511.01166 · Cited by 19
MRCA: metric-level root cause analysis for microservices via multi-modal data
Wang, Y., Zhu, Z., Fu, Q., Ma, Y., & He, P. (2024) · Proceedings of the 39th IEEE/ACM International Conference on Automated Software Engineering · doi:10.1145/3691620.3695485 · Cited by 18
“As systems and user demands grow in complexity and diversity, manual root cause analysis (RCA) becomes a challenging and time-consuming task [54].”
What Went Wrong? Explaining Cascading Failures in Microservice-Based Applications
Soldani, J., Montesano, G., & Brogi, A. (2021) · Communications in computer and information science · doi:10.1007/978-3-030-87568-8_9 · Cited by 18
Microservice architecture recovery based on intra-service and inter-service features
Wang, L., Hu, P., Kong, X., Ouyang, W., Li, B., Xu, H., & Shao, T. (2023) · Journal of Systems and Software · doi:10.1016/j.jss.2023.111754 · Cited by 18
Many-objective optimization of non-functional attributes based on refactoring of software models
Cortellessa, V., Pompeo, D. D., Stoico, V., & Tucci, M. (2023) · Information and Software Technology · doi:10.1016/j.infsof.2023.107159 · Cited by 18
Agentic Memory Enhanced Recursive Reasoning for Root Cause Localization in Microservices
Zhang, L., Jia, T., Zhai, Y., Pan, L., Duan, C., He, M., Jia, M., & Li, Y. (2026) · IEEE/ACM International Conference on Software Engineering: Software Engineering in Practice (ICSE-SEIP) · doi:10.1145/3786583.3786853 · Cited by 18
Zeng, Z., & Zhou, M. (2026) · Mathematics · doi:10.3390/math14020236 · Cited by 17
TraStrainer: Adaptive Sampling for Distributed Traces with System Runtime State
Huang, H., Zhang, X., Chen, P., He, Z., Zhi-ming, C., Yu, G., Chen, H., & Sun, C. (2024) · Proceedings of the ACM on software engineering. · doi:10.1145/3643748 · Cited by 18
MicroRes: Versatile Resilience Profiling in Microservices via Degradation Dissemination Indexing
Yang, T., Lee, C., Shen, J., Su, Y., Feng, C. Q., Yang, Y., & Lyu, M. R.-T. (2024) · ACM SIGSOFT International Symposium on Software Testing and Analysis (ISSTA) · doi:10.1145/3650212.3652131 · Cited by 17
“To address the challenge, we investigate the failure impact on two deployments of Train-Ticket [57], an open-source microservice benchmark system, with and without common resilience mechanisms (Section § 3.2).”
BackgroundMethodInfluentialExVivoMicroTest : ExVivo Testing of Microservices
Gazzola, L., Goldstein, M., Mariani, L., Mobilio, M., Segall, I., Tundo, A., & Ussi, L. (2022) · Journal of Software Evolution and Process · doi:10.1002/smr.2452 · Cited by 17
Adaptive Observability for Forensic-Ready Microservice Systems
Monteiro, D. E. S., Yu, Y., Zisman, A., & Nuseibeh, B. (2023) · IEEE Transactions on Services Computing · doi:10.1109/tsc.2023.3290474 · Cited by 17
“Existing studies use data collected by observability to automate debugging processes [54], [55], perform fault localisation [48], [56], and investigate the effectiveness of existing industrial debugging practices [47].”
ResultHolistic Root Cause Analysis for Failures in Cloud-Native Systems Through Observability Data
Han, Y., Du, Q., Huang, Y., Li, P., Shi, X., Wu, J., Fang, P., Tian, F., & He, C. (2024) · IEEE Transactions on Services Computing · doi:10.1109/tsc.2024.3478759 · Cited by 16
“F1, C1, P1, and P2 denote spans in “frontend1”, “checkout1”, “payment1”, and “payment2” respectively. systems, potentially resulting in significant costs in terms of customer impact [4], [5].”
Ren, R., Wang, Y., Liu, F., Li, Z., & Xie, G. (2023) · 2023 IEEE/ACM 31st International Symposium on Quality of Service (IWQoS) · doi:10.1109/iwqos57198.2023.10188773 · Cited by 16
“The system is widely used in existing works [21], [44], [45] and contains 41 microservices.”
MethodGrace: Interpretable Root Cause Analysis by Graph Convolutional Network for Microservices
Ren, R., Wang, Y., Liu, F., Li, Z., Tyson, G., Miao, T., & Xie, G. (2023) · International Workshop on Quality of Service · doi:10.1109/iwqos57198.2023.10188728 · Cited by 17
“It is widely used in existing works [9], [15], [16] and contains 41 microservices.”
MethodOnline Marketplace: A Benchmark for Data Management in Microservices
Laigner, R., Zhang, Z., Liu, Y., Gomes, L. F., & Zhou, Y. (2025) · Proceedings of the ACM on Management of Data · doi:10.1145/3709653 · Cited by 16
“Unfortunately, existing microservice benchmarks do not fully capture these real-world requirements [33, 41, 74].”
Cross-System Software Log-based Anomaly Detection Using Meta-Learning
Wang, Y., Mäntylä, M., Nyyssölä, J., Ping, K., & Wang, L. (2025) · IEEE International Conference on Software Analysis, Evolution and Reengineering (SANER) · doi:10.1109/saner64311.2025.00049 · Cited by 16
“The task is further complicated by the complexity of distributed systems, where the root cause of an issue may span multiple interconnected components [8], [9].”
Real-time Monitoring System for Container Networks in the Era of Microservices
Shiraishi, T., Noro, M., Kondo, R., Takano, Y., & Naoki, O. (2020) · Asia-Pacific Network Operations and Management Symposium (APNOMS) · doi:10.23919/apnoms50412.2020.9237055 · Cited by 16
Generic and robust root cause localization for multi-dimensional data in online service systems
Li, Z., Chen, J., Chen, Y., Luo, C., Zhao, Y., Sun, Y., Sui, K., Wang, X., Liu, D., Jin, X., et al. (2023) · Journal of Systems and Software · doi:10.1016/j.jss.2023.111748 · Cited by 16
No Free Lunch: Microservice Practices Reconsidered in IndustryPreprint
Xiang, Q., Peng, X., He, C., Wang, H., Xie, T., Liu, D., Zhang, G., & Cai, Y. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.07321 · Cited by 16
Self-citationZhang, X., Wang, Q., Li, M., Yuan, Y., Xiao, M., Zhuang, F., & Yu, D. (2025) · IEEE Transactions on Services Computing · doi:10.1109/tsc.2025.3629066 · Cited by 15
“Based on the unified representations, TAMO then invokes its specialized root cause localization tool and fault types classification tool for further identifying root cause and fault type underlying system context.”
Automated tactics planning for cyber attack and defense based on large language model agents
Ren, Y., Wang, J., Zhao, Z., Wen, H., Li, H., & Zhu, H. (2025) · Neural Networks · doi:10.1016/j.neunet.2025.107842 · Cited by 15
Seshagiri, V., Huye, D., Liu, L., Wildani, A., & Sambasivan, R. R. (2022) · Journal of Systems Research · doi:10.5070/sr32157839 · Cited by 15
“The next most widely used testbed is TrainTicket [69, 98, 99].”
BackgroundMethodTORAI: Multi-source Root Cause Analysis for Blind Spots in Microservice Service Call Graph
Pham, L., Ha, H., Zhang, X., & Zhang, H. (2026) · Proceedings of the ACM on software engineering. · doi:10.1145/3808137 · Cited by 15
An Empirical Study on Microservice Software Development
Ramírez, F., Mera‐Gómez, C., Bahsoon, R., & Zhang, Y. (2021) · IEEE/ACM Joint International Workshop on Software Engineering for Systems-of-Systems and Workshop on Distributed Software Development, Software Ecosystems and Systems-of-Systems (SESoS/WDES) · doi:10.1109/sesos-wdes52566.2021.00008 · Cited by 15
On the impact of Performance Antipatterns in multi-objective software model refactoring optimization
Cortellessa, V., Pompeo, D. D., Stoico, V., & Tucci, M. (2021) · Euromicro Conference on Software Engineering and Advanced Applications (SEAA) · doi:10.1109/seaa53835.2021.00036 · Cited by 15
“In this section, we apply our approach to the Train Ticket Booking Service (TTBS) case study [24], [25].”
MethodZhang, N., Zou, Y., Xia, X., Huang, Q., Lo, D., & Li, S. (2022) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2022.3154769 · Cited by 15
“IT5 [58], [59] IT7 [20], [26], [29], [60], [61], [62] IT10 [58], [63], [64] IT11 [65] IT12 [58] IT14 [58], [65] IT15 [58], [65], [66] IT18 [21], [64], [67] IT19 [21], [67] IT20 [61], [67] ZHANG ETAL.”
BackgroundInfluentialIter8: Online Experimentation in the Cloud
Toslali, M., Parthasarathy, S., Oliveira, F., Huang, H. P., & Coskun, A. K. (2021) · ACM Symposium on Cloud Computing (SoCC) · doi:10.1145/3472883.3486984 · Cited by 15
“In our accuracy evaluation, we use the Train Ticket [80] benchmark application, which is widely used and the largest publicly available microservicebased application.”
MethodCausal Modeling based Fault Localization in Cloud Systems using Golden Signals
Aggarwal, P., Nagar, S., Gupta, A., Shwartz, L., Mohapatra, P., Wang, Q., Paradkar, A. M., & Mandal, A. (2021) · IEEE ... International Conference on Cloud Computing · doi:10.1109/cloud53861.2021.00026 · Cited by 15
“The faults reported in these incidents can be clas-sified in one of the 22 industrial faults (F1,F2...,F12,F22) as described in [22].”
BackgroundTrace-based Intelligent Fault Diagnosis for Microservices with Deep Learning
Chen, H., Wei, K., Li, A., Wang, T., & Zhang, W. (2021) · 2021 IEEE 45th Annual Computers, Software, and Applications Conference (COMPSAC) · doi:10.1109/compsac51774.2021.00121 · Cited by 14
Identifying Performance Issues in Microservice Architectures through Causal Reasoning
Giamattei, L., Guerriero, A., Malavolta, I., Mascia, C., Pietrantuono, R., & Russo, S. (2024) · doi:10.1145/3644032.3644460 · Cited by 14
Seeding and Mocking in White-Box Fuzzing Enterprise RPC APIs: An Industrial Case Study
Zhang, M., Arcuri, A., Teng, P., Xue, K., & Wang, W. (2024) · IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1145/3691620.3695265 · Cited by 14
“Therefore, there is an increasing interest for tackling these challenges in academic research and in industry [32, 34, 50, 51, 54, 55].”
SparseRCA: Unsupervised Root Cause Analysis in Sparse Microservice Testing Traces
Yao, Z., Ye, H., Pei, C., Cheng, G., Wang, G., Liu, Z., Chen, H., Cui, H., Li, Z., Li, J., et al. (2024) · Proceedings/Proceedings - International Symposium on Software Reliability Engineering · doi:10.1109/issre62328.2024.00045 · Cited by 15
“In the testing environment, because of the high cost of constructing test cases [6], [34], traces of microservices are significantly sparser than in the production environment.”
Tracezip: Efficient Distributed Tracing via Trace Compression
Chen, Z., Pu, J., & Zheng, Z. (2025) · Proceedings of the ACM on software engineering. · doi:10.1145/3728888 · Cited by 14
“The selected services include one microservices benchmark named Train Ticket [52] and six open-source application components, including gRPC, Apache Kafka, Servlet, MySQL, Redis, MongoDB.”
InfluentialYaroshynskyi, M., Puchko, I., Prymushko, A., Kravtsov, H., & Артемчук, В. О. (2025) · Digital · doi:10.3390/digital5030027 · Cited by 14
Testing acoustic scene classifiers using Metamorphic Relations
Moreira, D., Furtado, A. P., & Nogueira, S. (2020) · IEEE International Conference on Artificial Intelligence Testing (AITest) · doi:10.1109/aitest49225.2020.00014 · Cited by 14
Volpert, S., Eichhammer, P., Held, F., Huffert, T., Reiser, H. P., & Domaschka, J. (2022) · Future Generation Computer Systems · doi:10.1016/j.future.2022.11.024 · Cited by 14
Traini, L., & Cortellessa, V. (2023) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2023.3266041 · Cited by 14
“, a single RPC is involved), and performance issues that arises from the interaction of multiple services [8] (i.”
BackgroundMethodInfluentialTraceStream: Anomalous Service Localization based on Trace Stream Clustering with Online Feedback
Zhou, T., Zhang, C., Peng, X., Yan, Z., Li, P., Liang, J., Zheng, H., Zheng, W., & Deng, Y. (2023) · Proceedings/Proceedings - International Symposium on Software Reliability Engineering · doi:10.1109/issre59848.2023.00033 · Cited by 14
“We evaluate TraceStream by answering the following research questions: A. Experiment Setting 1) Datasets: We conduct experiments on TrainTicket [25], [26], an open-source benchmark microserivce system widely used in researches on microservice systems.”
MethodSelf-citationImpactTracer: Root Cause Localization in Microservices Based on Fault Propagation Modeling
Xie, R., Yang, J., Li, J., & Wang, L. (2023) · 2023 Design, Automation & Test in Europe Conference & Exhibition (DATE) · doi:10.23919/date56975.2023.10137078 · Cited by 13
A 2030 Roadmap for Software Engineering
Pezzè, M., Abrahão, S., Penzenstadler, B., Poshyvanyk, D., Roychoudhury, A., & Yue, T. (2025) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3731559 · Cited by 13
A fuzzy logic-based quality model for identifying microservices with low maintainability
Yılmaz, R., & Buzluca, F. (2024) · Journal of Systems and Software · doi:10.1016/j.jss.2024.112143 · Cited by 14
“To evaluate our approach, we created a test set of microservices with the help of three developers who evaluated and categorized 36 microservices in the open-source “Train Ticket” project [17] based on their experience and knowledge.”
MethodAutomated Grey-Box Testing of Microservice Architectures
Giamattei, L., Guerriero, A., Pietrantuono, R., & Russo, S. (2022) · IEEE International Conference on Software Quality, Reliability and Security (QRS) · doi:10.1109/qrs57517.2022.00070 · Cited by 13
“This MSA has been extensively used in previous research and is considered representative of a real-world MSA [23], [34]–[42].”
MethodA systematic mapping study of bug reproduction and localization
Wang, D., Galster, M., & Morales-Trujillo, M. E. (2023) · Information and Software Technology · doi:10.1016/j.infsof.2023.107338 · Cited by 13
A case for microservices orchestration using workflow engines
Nadeem, A., & Malik, M. Z. (2022) · IEEE/ACM International Conference on Software Engineering: New Ideas and Emerging Results (ICSE-NIER) · doi:10.1145/3510455.3512777 · Cited by 12
“Large web companies such as Tencent, Uber, Netflix, and Airbnb are increasingly building their core business systems using microservice architecture [24].”
BackgroundMethodInfluentialLiao, L., Eismann, S., Li, H., Bezemer, C., Costa, D. E., van Hoorn, A., & Shang, W. (2025) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1109/icse55347.2025.00026 · Cited by 12
“In the experimental results, we find that by bridging local performance data and architectural models, our approach can effectively detect end-to-end system performance regressions with different intensities of local performance deviations and can maintain its effectiveness when the system…”
Leveraging multi-agent framework for root cause analysis
Fu, F., Ding, H., Qin, Y., Yu, J., & Xu, D. (2025) · Complex & Intelligent Systems · doi:10.1007/s40747-025-02096-0 · Cited by 12
“Early approaches [9, 16, 36] employed rule-based and statistical heuristics (e.g., decision trees, correlation analysis) to directly map symptoms to root causes, bypassingdynamicdatacollectionandanalysis.”
Xiao, Z., Liu, X., Ma, W., Li, X., & Liu, Z. (2026) · International Conference on Computer Information Science and Application Technology (CISAT) · doi:10.1109/cisat71030.2026.11682084 · Cited by 12
“We evaluate on 180 labeled incidents from two open-source microservice benchmarks: TrainTicket [15] (120 incidents, 41 services) and OnlineBoutique (60 incidents, 11 services), drawn from the Nezha dataset release.”
Deep Learning-Based Log Anomaly Detection for 5G Core Network
Tan, Y., Wang, J., Liu, J., & Li, Y. (2023) · IEEE/CIC International Conference on Communications in China (ICCC) · doi:10.1109/iccc57788.2023.10233555 · Cited by 12
“We generate two types of anomalies inspired by [9] using Open5GS as the simulator.”
MethodKolla, S. (2019) · Turkish Journal of Computer and Mathematics Education (TURCOMAT) · doi:10.61841/turcomat.v10i1.15043 · Cited by 12
Detecting Latency Degradation Patterns in Service-based Systems
Cortellessa, V., & Traini, L. (2020) · ACM/SPEC International Conference on Performance Engineering (ICPE) · doi:10.1145/3358960.3379126 · Cited by 12
“Modern service-based systems involve many asynchronous interactions [7], therefore many RPCs execution times variations could not produce any degradation on request latency.”
BackgroundMethodInfluentialMicroservice Anomaly Detection Based on Tracing Data Using Semi-supervised Learning
Li, M., Tang, D., Wen, Z., & Cheng, Y. (2021) · 2021 4th International Conference on Artificial Intelligence and Big Data (ICAIBD) · doi:10.1109/icaibd51990.2021.9459100 · Cited by 11
DyCause: Crowdsourcing to Diagnose Microservice Kernel Failure
Pan, Y., Ma, M., Jiang, X., & Wang, P. (2023) · IEEE Transactions on Dependable and Secure Computing · doi:10.1109/tdsc.2022.3233915 · Cited by 11
“These incidents not only cause economic losses for online business services but also degrades the reputation of cloud platforms [6].”
BackgroundSubstructure-Aware Log Anomaly Detection
Tang, Y., Zhang, Z., Zhao, K., Fang, L., Li, Z., & Chen, W. (2024) · Proceedings of the VLDB Endowment · doi:10.14778/3705829.3705840 · Cited by 11
“System logs are a valuable resource in system monitoring and trou-bleshooting, as they encompass the interdependencies among various components and operational processes within the system [43].”
A Hybrid and Modular Integration Concept for Anomaly Detection in Industrial Control Systems
Goetz, C., & Humm, B. G. (2025) · AI · doi:10.3390/ai6050091 · Cited by 11
“This is especially challenging in decentralized integration, where different devices, such as control units, can be actively influenced by the integration of additional software [50,51].”
Interaction Prediction and Anomaly Detection in a Microservices-based Telecommunication Platform
Aktaş, K., & Kılınç, H. H. (2024) · doi:10.1145/3666015.3666017 · Cited by 11
“Zhou et al. [14] conducted an industrial survey and an empirical study to investigate fault analysis and debugging in complex mi-croservice systems.”
Making Fault Localization in Online Service Systems More Actionable and Interpretable
Xv, K., Guo, S., Li, H., Li, C., Chen, R., Li, X., & Jiang, H. (2025) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3714466 · Cited by 12
“We implemented FL-AIer and all state-of-the-art methods based on PyTorch and DGL [43].”
InfluentialEnhancing Fault Injection Testing of Service Systems via Fault-Tolerance Bottleneck
Wu, H., Yu, S., Niu, X., Nie, C., Pei, Y., He, Q., & Yang, Y. J. (2023) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2023.3285357 · Cited by 11
“We selected SockShop [39] and TrainTicket [40], two widely used open-source microservice benchmark systems [45], [46], [47], [48], [49], [50], [51], [52], as the experiment subjects.”
BackgroundMethodUnderstanding the Issues, Their Causes and Solutions in Microservices Systems: An Empirical StudyPreprint
Waseem, M., Liang, P., Ahmad, A., Khan, A. A., Shahin, M., Abrahamsson, P., Nasab, A. R., & Mikkonen, T. (2023) · Jyväskylä University Digital Archive (University of Jyväskylä) · doi:10.48550/arxiv.2302.01894 · Cited by 11
“Storage Issues : One major problem that practitioners encounter is related to memory management, as per the build, execution, and deployment requirements of microser-vices [60, 61].”
InfluentialThe Multi-Agent Fault Localization System Based on Monte Carlo Tree Search ApproachPreprint
Ren, R. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2507.22800 · Cited by 11
“Further elaboration on these details of prompt template of Multi-Agent can be found in the appendix A. Dataset B are obtained from the Trainticket benchmark platform [31].”
OpenRCA 2.0: From Outcome Labels to Causal Process SupervisionPreprint
Fang, A., Yang, Y., Shang, J., Qisheng, L., Xu, J., Wang, R., Zhang, S., Zhang, Y., Yu, B., & He, P. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2606.27154 · Cited by 14
“The originating fault is rarely where symptoms first appear: modern cloud applications are split into dozens of small components communicating over the network [5], so a local fault can cascade through callers and reach distant parts of the system before any human notices.”
Influential
Metadata
- Authors
- Zhou, X., Peng, X., Xie, T., Sun, J., Ji, C., Li, W., & Ding, D.
- Affiliations
- Fudan University (CN)
- University of Illinois Urbana-Champaign (US)
- Singapore University of Technology and Design (SG)
- Venue
- IEEE Transactions on Software Engineering
- Published
- 2021-02-01
- Volume
- 47
- Issue
- 2
- Pages
- 243-260
- ISSN
- 0098-5589 (ISSN-L)
- 1939-3520
- 2326-3881
- OpenAlex
- W2903799441
- Cited by
- 410
- References
- 42
- Citations by year
- 2026: 70 · 2025: 64 · 2024: 82 · 2023: 68 · 2022: 58 · 2021: 40
- FWCI
- 10.53
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- Locations
- IEEE Transactions on Software Engineering (publishedVersion)
- Singapore Management University Institutional Knowledge (InK) (Singapore Management University) (submittedVersion)
- Funders
- National Key Research and Development Program of China (2018YFB1004803)
- National Science Foundation (CNS-1513939, CNS-1564274, CCF-1816615)
- Topics
- Physical Sciences › Computer Science › Computer Networks and Communications › Software System Performance and Reliability
- Physical Sciences › Computer Science › Software › Software Testing and Debugging Techniques
- Physical Sciences › Computer Science › Information Systems › Software Engineering Research
- Keywords
- microservices, fault analysis, debugging, distributed systems, tracing, trace visualization, fault location, benchmark systems, industrial survey, developer practices, trace analysis
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.