A Framework of Virtual War Room and Matrix Sketch-Based Streaming Anomaly Detection for Microservice Systems
Open accessThe DOI matches its Crossref record; 32 of the 33 references it cites were found in a registry or an index.
Abstract
Recently, microservice has been a popular architecture to construct cloud-native systems. This novel architecture brings agility and accelerates the software development process significantly. However, it is not easy to manage and operate microservice systems due to their scale and complexity. Many approaches are proposed to automatically operate microservice systems such as anomaly detection. Nevertheless, those methods cannot be sufficiently validated and compared due to a lack of real microservice systems, which leads to the slow process of intelligent operation. These challenges inspire us to build a system named “VWR”, a framework of Virtual War Room for operating microservice applications which allows users to simulate their microservice architectures with low overhead and inject multiple types of faults into the microservice system with chaos engineering. VWR can mimic user requests and record the end-to-end tracing data (i.e., service call chains) for each request in a way consistent with OpenTracing. With easily designed tests and the produced streaming tracing data, the users can validate the performance of their intelligent operation algorithms and improve the algorithms as needed. Besides, based on the streaming tracing data generated by VWR, we introduce a novel unsupervised anomaly detection algorithm based on Matrix Sketch and set it as a default intelligent operation algorithm in VWR. This algorithm can detect anomalies by analyzing high-dimensional performance data collected from a microservice system in a streaming manner. The experimental result in VWR shows that the matrix sketch based method can precisely detect anomalies in microservice systems and outperform some widely used anomaly detection methods such as isolation forest in some scenario. We believe more approaches on the intelligent operation of microservice systems can be constructed based on VWR.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Other lightweight approaches include SVMs for API traffic [95], randomized matrix sketching for streaming data [118], and regression-based models such as Syslrn [70] that reduce data requirements through offline feature selection.”
From Anomaly detection and root-cause identification in microservices: a survey (2026) · cites this paper as [118]
Citations
Cites
Chandola, V., Banerjee, A., & Kumar, V. (2009) · ACM Computing Surveys · doi:10.1145/1541880.1541882 · Cited by 11,687 · cited 1×
“What is more, some other supervised approaches have been proposed for anomaly detection such as [26] and [27] which needs labeled data.”
BackgroundLiu, F. T., Ting, K. M., & Zhou, Z.-H. (2008) · 2008 Eighth IEEE International Conference on Data Mining · doi:10.1109/icdm.2008.17 · Cited by 6,601 · cited 3×
“The state-of-art approach IForest [25] is an efficient method that is not suitable for real-time scenarios.”
MethodZooKeeper: wait-free coordination for internet-scale systems
Hunt, P. G., Konar, M., Junqueira, F., & Reed, B. C. (2010) · USENIX Annual Technical Conference · Cited by 1,968
Anomaly Detection with Robust Deep Autoencoders
Zhou, C., & Paffenroth, R. C. (2017) · Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/3097983.3098052 · Cited by 1,436
Pinpoint: problem determination in large, dynamic Internet services
Chen, M. Y., Kiciman, E., Fratkin, E., Fox, A., & Brewer, E. (2003) · Proceedings International Conference on Dependable Systems and Networks · doi:10.1109/dsn.2002.1029005 · Cited by 835
Gan, Y., Zhang, Y., Cheng, D., Shetty, A., Rathi, P., Katarki, N., Bruno, A., Hu, J., Ritchken, B., Jackson, B., et al. (2019) · Proceedings of the Twenty-Fourth International Conference on Architectural Support for Programming Languages and Operating Systems · doi:10.1145/3297858.3304013 · Cited by 665 · cited 1×
“DeathstarBench [31] focuses on deploying large-scale applications with several different services, which allows us to study the performance effect that only exists in large-scale systems.”
BackgroundUsing magpie for request extraction and workload modelling
Barham, P., Donnelly, A., Isaacs, R., & Mortier, R. (2004) · Operating Systems Design and Implementation · Cited by 559
X-trace: a pervasive network tracing framework
Fonseca, R., Porter, G., Katz, R. H., Shenker, S. J., & Stoica, I. G. (2007) · Cited by 438
Zhou, X., Peng, X., Xie, T., Sun, J., Ji, C., Li, W., & Ding, D. (2021) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2018.2887384 · Cited by 410
Path-based faliure and evolution management
Chen, M. Y., Accardi, A., Kıcıman, E., Lloyd, J., Patterson, D., Fox, A., & Brewer, E. (2004) · Networked Systems Design and Implementation · Cited by 302
Research works printed but not linked: 14
- 2018, Filebeat
- cohen, 2013, Announcing Zuul Edge Service in the Cloud
- ranganathan, 2012, Netflix shares cloud load balancing and failover tool Eureka!
- gormley, 2015, Elasticsearch The Definitive Guide A Distributed Real-Time Search and Analytics Engine
- 2018, Socks Shop—A Microservices Demo Application
- bennett, 2012, Chaos Monkey Released Into The Wild
- 2019, Istio
- zhang, 2019, $\mu$ qSim: Enabling accurate and scalable simulation for interactive microservices, Proc IEEE Int Symp Perform Anal Syst Softw (ISPASS), 212
- 2019, Zipkin Homepage
- cockcroft, 2016, The evolution of microservices, Proc ACM Learn Webinar, 1
- cockroft, 2016, Microservices: Why, what, and how to get there, Microservices Workshop All Topics Deck
- reynolds, 2016, Vizceral Open Source
- aggarwal, 2016, Outlier Analysis
- 2019, Zipkin Span
Cited by
Soldani, J., & Brogi, A. (2023) · ACM Computing Surveys · doi:10.1145/3501297 · Cited by 256
“An alternative approach to machine learning is trace comparison, which is enacted by Chen et al. [17], Meng et al. [54], and Wang et al. [88], all based on instrumenting applications to feature distributed tracing.”
BackgroundMethodInfluentialReview of Anomaly Detection Algorithms for Data Streams
Lu, T., Wang, L., & Zhao, X. (2023) · Applied Sciences · doi:10.3390/app13106353 · Cited by 100
On Microservice Analysis and Architecture Evolution: A Systematic Mapping Study
Bushong, V., Abdelfattah, A. S., Maruf, A. A., Das, D., Lehman, A., Jaroszewski, E., Coffey, M., Cerny, T., Frajták, K., Tisnovsky, P., et al. (2021) · Applied Sciences · doi:10.3390/app11177856 · Cited by 116
Microservice security: a systematic literature review
Berardi, D., Giallorenzo, S., Mauro, J., Melis, A., Montesi, F., & Prandini, M. (2022) · PeerJ Computer Science · doi:10.7717/peerj-cs.779 · Cited by 94
TraceGra: A trace-based anomaly detection for microservice using graph deep learning
Chen, J., Liu, F., Jiang, J., Zhong, G., Xu, D., Tan, Z., & Shi, S. (2023) · Computer Communications · doi:10.1016/j.comcom.2023.03.028 · Cited by 55
A Systematic Review on Anomaly Detection for Cloud Computing Environments
Hagemann, T., & Katsarou, K. (2020) · Artificial Intelligence and Cloud Computing Conference (AICCC) · doi:10.1145/3442536.3442550 · Cited by 82
Anomaly Detection in Microservice-Based Systems
Nobre, J., Pires, E. J. S., & Reis, A. (2023) · Applied Sciences · doi:10.3390/app13137891 · Cited by 34
Rahman, M. A., Abuludin, M. S., Yuan, L. X., Islam, M. S., & Asyhari, A. T. (2021) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2021.3093475 · Cited by 39
Belhadi, A., Djenouri, Y., Srivastava, G., & Lin, J. C.-W. (2021) · Computer Communications · doi:10.1016/j.comcom.2021.07.010 · Cited by 26
Sieve: Attention-based Sampling of End-to-End Trace Data in Distributed Microservice Systems
Huang, Z., Chen, P., Yu, G., Chen, H., & Zheng, Z. (2021) · 2021 IEEE International Conference on Web Services (ICWS) · doi:10.1109/icws53863.2021.00063 · Cited by 22
Self-citationTowards a Fault Taxonomy for Microservices-Based Applications
Silva, F., Lelli, V., Santos, I. D. S., & Andrade, R. M. C. (2022) · Brazilian Symposium on Software Engineering · doi:10.1145/3555228.3555245 · Cited by 21
Microservice transition and its granularity problem: A systematic mapping study
Hassan, S. M., Bahsoon, R., & Kazman, R. (2020) · Software Practice and Experience · doi:10.1002/spe.2869 · Cited by 120
Real-Time Anomaly Detection Using Distributed Tracing in Microservice Cloud Applications
Raeiszadeh, M., Ebrahimzadeh, A., Saleem, A., Glitho, R., Eker, J., & Mini, R. A. F. (2023) · IEEE International Conference on Cloud Networking · doi:10.1109/cloudnet59005.2023.10490038 · Cited by 20
Alarm reduction and root cause inference based on association mining in communication network
Li, M., Yang, M., & Chen, P. (2023) · Frontiers in Computer Science · doi:10.3389/fcomp.2023.1211739 · Cited by 15
Self-citationMonitoring Data for Anomaly Detection in Cloud-Based Systems: A Systematic Mapping Study
Hrusto, A., bin Ali, N., Engström, E., & Wang, Y. (2025) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3744556 · Cited by 19
TraLogAnomaly: A microservice system anomaly detection approach based on hybrid event sequences
Wei, X., Sun, C., Yang, P., Zhang, X., & Towey, D. (2025) · Science of Computer Programming · doi:10.1016/j.scico.2025.103303 · Cited by 11
Requirements for Anomaly Detection Techniques for Microservices
Steidl, M., Gattringer, M., Felderer, M., Ramler, R., & Shahriari, M. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-21388-5_3 · Cited by 9
Chaos experiments in microservice architectures: A systematic literature review
Esen, E., Akbulut, A., & Catal, C. (2025) · Computer Standards & Interfaces · doi:10.1016/j.csi.2025.104116 · Cited by 5
A Systematic Literature Review on Fault Injection Testing of Microservice Systems
Yu, S., Wu, H., Niu, X., & Nie, C. (2025) · IEEE Transactions on Services Computing · doi:10.1109/tsc.2025.3621564 · Cited by 10
An effective failure detection method for microservice-based systems using distributed tracing data
Purfallah, Z., & Rasoolzadegan, A. (2024) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2024.108558 · Cited by 16
Performance analysis with self-organizing map and recurrent neural network
Yan, Y. (2022) · Advances in Complex Systems · doi:10.1142/s1793962322500593 · Cited by 3
AIOps: Analysing Cloud Failure Detection Approaches for Enhanced Operational Efficency
Kumar, P., & Kumar, H. S. (2023) · International Conference on Applied Intelligence and Sustainable Computing (ICAISC) · doi:10.1109/icaisc58445.2023.10199929 · Cited by 5
Qi, P., Tao, D., & Gao, R. (2026) · IEEE Transactions on Cloud Computing · doi:10.1109/tcc.2026.3665339 · Cited by 1
Anomaly detection and root-cause identification in microservices: a survey
Barata, L. M., Sequeira, S., Lopes, E., Inácio, P. R. M., & Freire, M. M. (2026) · Cluster Computing · doi:10.1007/s10586-026-06095-9 · Cited by 4
“Other lightweight approaches include SVMs for API traffic [ 95], randomized matrix sketching for streaming data [ 118], and regression-based models such as Syslrn [70] that reduce data requirements through offline feature selection.”
Distributed Multi-agent Modeling of Complex Systems
Verkhova, G. V., Akimov, S. V., & Prisyazhnyuk, S. P. (2021) · IEEE International Conference on Soft Computing and Measurements (SCM) · doi:10.1109/scm52931.2021.9507194
Peer Review #1 of "Microservice security: a systematic literature review (v0.1)"
(2022) · PeerJ Computer Science · doi:10.7287/peerj-cs.779v0.1/reviews/1
Peer Review #3 of "Microservice security: a systematic literature review (v0.2)"
(2022) · PeerJ Computer Science · doi:10.7287/peerj-cs.779v0.2/reviews/3
Peer Review #3 of "Microservice security: a systematic literature review (v0.1)"
(2022) · PeerJ Computer Science · doi:10.7287/peerj-cs.779v0.1/reviews/3
Peer Review #2 of "Microservice security: a systematic literature review (v0.2)"
(2022) · PeerJ Computer Science · doi:10.7287/peerj-cs.779v0.2/reviews/2
Peer Review #2 of "Microservice security: a systematic literature review (v0.1)"
(2022) · PeerJ Computer Science · doi:10.7287/peerj-cs.779v0.1/reviews/2
SCLFD: A Novel Latency Fault Detection Approach for Service Composition
Zhang, Z., Shen, Z., Xu, X., & He, H. (2023) · International Conference on Computer, Big Data and Artificial Intelligence (ICCBD+AI) · doi:10.1109/iccbd-ai62252.2023.00122
Liang, Y., Wang, Y., Xu, G., & Ruan, N. (2025) · International Conference on Computer, Control and Robotics (ICCCR) · doi:10.1109/icccr65461.2025.11072588
Cloud-Native Transformations: Microservices, Kubernetes, and Security Frameworks in Practice
Munthe, E. S. (2025) · Digitus Journal of Computer Science Applications · doi:10.61978/digitus.v3i2.880
Log-based anomaly detection for evolving software: An incremental deep-learning approach
Wei, X., Sun, C., Zhang, X., & Towey, D. (2026) · Information and Software Technology · doi:10.1016/j.infsof.2026.108199 · Cited by 1
A Domain-Driven Design Simulator for Business Logic-Rich Microservice SystemsPreprint
Pereira, D. D. P., & Silva, A. R. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.6880208
Qi, P., Tao, D., & Gao, R. (2026) · IEEE Transactions on Network and Service Management · doi:10.1109/tnsm.2026.3713918
Metadata
- Authors
- Chen, H., Chen, P., & Yu, G.
- Affiliations
- Sun Yat-sen University (CN)
- Venue
- IEEE Access
- Published
- 2020
- Volume
- 8
- Pages
- 43413-43426
- ISSN
- 2169-3536 (ISSN-L)
- OpenAlex
- W3009134255
- Cited by
- 36
- References
- 33
- Citations by year
- 2026: 5 · 2025: 6 · 2024: 1 · 2023: 6 · 2022: 11 · 2021: 5 · 2020: 2
- FWCI
- 2.82
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Locations
- IEEE Access (publishedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- National Key Research and Development Plan (2019YFB1804002)
- National Natural Science Foundation of China (61802448, 6190244, U1811462)
- Natural Science Foundation of Guangdong Province (2019A1515012229)
- Topics
- Physical Sciences › Computer Science › Computer Networks and Communications › Software System Performance and Reliability
- Physical Sciences › Computer Science › Artificial Intelligence › Anomaly Detection Techniques and Applications
- Physical Sciences › Computer Science › Information Systems › Cloud Computing and Resource Management
- Keywords
- microservices, anomaly detection, chaos engineering, fault injection, streaming anomaly detection, intelligent operation, cloud-native systems, unsupervised anomaly detection
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.