A Framework of Virtual War Room and Matrix Sketch-Based Streaming Anomaly Detection for Microservice Systems
Open accessThe DOI matches its Crossref record; 32 of the 33 references it cites were found in a registry or an index.
Abstract
Recently, microservice has been a popular architecture to construct cloud-native systems. This novel architecture brings agility and accelerates the software development process significantly. However, it is not easy to manage and operate microservice systems due to their scale and complexity. Many approaches are proposed to automatically operate microservice systems such as anomaly detection. Nevertheless, those methods cannot be sufficiently validated and compared due to a lack of real microservice systems, which leads to the slow process of intelligent operation. These challenges inspire us to build a system named “VWR”, a framework of Virtual War Room for operating microservice applications which allows users to simulate their microservice architectures with low overhead and inject multiple types of faults into the microservice system with chaos engineering. VWR can mimic user requests and record the end-to-end tracing data (i.e., service call chains) for each request in a way consistent with OpenTracing. With easily designed tests and the produced streaming tracing data, the users can validate the performance of their intelligent operation algorithms and improve the algorithms as needed. Besides, based on the streaming tracing data generated by VWR, we introduce a novel unsupervised anomaly detection algorithm based on Matrix Sketch and set it as a default intelligent operation algorithm in VWR. This algorithm can detect anomalies by analyzing high-dimensional performance data collected from a microservice system in a streaming manner. The experimental result in VWR shows that the matrix sketch based method can precisely detect anomalies in microservice systems and outperform some widely used anomaly detection methods such as isolation forest in some scenario. We believe more approaches on the intelligent operation of microservice systems can be constructed based on VWR.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Other lightweight approaches include SVMs for API traffic [95], randomized matrix sketching for streaming data [118], and regression-based models such as Syslrn [70] that reduce data requirements through offline feature selection.”
From Anomaly detection and root-cause identification in microservices: a survey (2026) · cites this paper as [118]
Citations
Cites
Chandola, V., Banerjee, A., & Kumar, V. (2009) · ACM Computing Surveys · doi:10.1145/1541880.1541882 · Cited by 11,687 · cited 1×
“What is more, some other supervised approaches have been proposed for anomaly detection such as [26] and [27] which needs labeled data.”
BackgroundLiu, F. T., Ting, K. M., & Zhou, Z.-H. (2008) · 2008 Eighth IEEE International Conference on Data Mining · doi:10.1109/icdm.2008.17 · Cited by 6,601 · cited 3×
“The state-of-art approach IForest [25] is an efficient method that is not suitable for real-time scenarios.”
MethodZooKeeper: wait-free coordination for internet-scale systems
Hunt, P. G., Konar, M., Junqueira, F., & Reed, B. C. (2010) · USENIX Annual Technical Conference · Cited by 1,968
Anomaly Detection with Robust Deep Autoencoders
Zhou, C., & Paffenroth, R. C. (2017) · Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/3097983.3098052 · Cited by 1,436
Pinpoint: problem determination in large, dynamic Internet services
Chen, M. Y., Kiciman, E., Fratkin, E., Fox, A., & Brewer, E. (2003) · Proceedings International Conference on Dependable Systems and Networks · doi:10.1109/dsn.2002.1029005 · Cited by 835
Gan, Y., Zhang, Y., Cheng, D., Shetty, A., Rathi, P., Katarki, N., Bruno, A., Hu, J., Ritchken, B., Jackson, B., et al. (2019) · Proceedings of the Twenty-Fourth International Conference on Architectural Support for Programming Languages and Operating Systems · doi:10.1145/3297858.3304013 · Cited by 665
Using magpie for request extraction and workload modelling
Barham, P., Donnelly, A., Isaacs, R., & Mortier, R. (2004) · Operating Systems Design and Implementation · Cited by 559
X-trace: a pervasive network tracing framework
Fonseca, R., Porter, G., Katz, R. H., Shenker, S. J., & Stoica, I. G. (2007) · Cited by 438
Zhou, X., Peng, X., Xie, T., Sun, J., Ji, C., Li, W., & Ding, D. (2021) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2018.2887384 · Cited by 410
Path-based faliure and evolution management
Chen, M. Y., Accardi, A., Kıcıman, E., Lloyd, J., Patterson, D., Fox, A., & Brewer, E. (2004) · Networked Systems Design and Implementation · Cited by 302
Research works printed but not linked: 14
- 2018, Filebeat
- cohen, 2013, Announcing Zuul Edge Service in the Cloud
- ranganathan, 2012, Netflix shares cloud load balancing and failover tool Eureka!
- gormley, 2015, Elasticsearch The Definitive Guide A Distributed Real-Time Search and Analytics Engine
- 2018, Socks Shop—A Microservices Demo Application
- bennett, 2012, Chaos Monkey Released Into The Wild
- 2019, Istio
- zhang, 2019, $\mu$ qSim: Enabling accurate and scalable simulation for interactive microservices, Proc IEEE Int Symp Perform Anal Syst Softw (ISPASS), 212
- 2019, Zipkin Homepage
- cockcroft, 2016, The evolution of microservices, Proc ACM Learn Webinar, 1
- cockroft, 2016, Microservices: Why, what, and how to get there, Microservices Workshop All Topics Deck
- reynolds, 2016, Vizceral Open Source
- aggarwal, 2016, Outlier Analysis
- 2019, Zipkin Span
Cited by
Soldani, J., & Brogi, A. (2023) · ACM Computing Surveys · doi:10.1145/3501297 · Cited by 256
“An alternative approach to machine learning is trace comparison, which is enacted by Chen et al. [17], Meng et al. [54], and Wang et al. [88], all based on instrumenting applications to feature distributed tracing.”
BackgroundMethodInfluentialReview of Anomaly Detection Algorithms for Data Streams
Lu, T., Wang, L., & Zhao, X. (2023) · Applied Sciences · doi:10.3390/app13106353 · Cited by 100
On Microservice Analysis and Architecture Evolution: A Systematic Mapping Study
Bushong, V., Abdelfattah, A. S., Maruf, A. A., Das, D., Lehman, A., Jaroszewski, E., Coffey, M., Cerny, T., Frajták, K., Tisnovsky, P., et al. (2021) · Applied Sciences · doi:10.3390/app11177856 · Cited by 116
Microservice security: a systematic literature review
Berardi, D., Giallorenzo, S., Mauro, J., Melis, A., Montesi, F., & Prandini, M. (2022) · PeerJ Computer Science · doi:10.7717/peerj-cs.779 · Cited by 94
TraceGra: A trace-based anomaly detection for microservice using graph deep learning
Chen, J., Liu, F., Jiang, J., Zhong, G., Xu, D., Tan, Z., & Shi, S. (2023) · Computer Communications · doi:10.1016/j.comcom.2023.03.028 · Cited by 55
Metadata
- Authors
- Chen, H., Chen, P., & Yu, G.
- Affiliations
- Sun Yat-sen University (CN)
- Venue
- IEEE Access
- Published
- 2020
- Volume
- 8
- Pages
- 43413-43426
- ISSN
- 2169-3536 (ISSN-L)
- OpenAlex
- W3009134255
- Cited by
- 36
- References
- 33
- Citations by year
- 2026: 5 · 2025: 6 · 2024: 1 · 2023: 6 · 2022: 11 · 2021: 5 · 2020: 2
- FWCI
- 2.82
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Locations
- IEEE Access (publishedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- National Key Research and Development Plan (2019YFB1804002)
- National Natural Science Foundation of China (61802448, 6190244, U1811462)
- Natural Science Foundation of Guangdong Province (2019A1515012229)
- Topics
- Physical Sciences › Computer Science › Computer Networks and Communications › Software System Performance and Reliability
- Physical Sciences › Computer Science › Artificial Intelligence › Anomaly Detection Techniques and Applications
- Physical Sciences › Computer Science › Information Systems › Cloud Computing and Resource Management
- Keywords
- microservices, anomaly detection, chaos engineering, fault injection, streaming anomaly detection, intelligent operation, cloud-native systems, unsupervised anomaly detection
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: A Framework of Virtual War Room and Matrix Sketch-Based Streaming Anomaly Detection for Microservice Systems. https://app.cochat.ai/papers/10.1109/access.2020.2977464
- The paper
- Chen, H., Chen, P., & Yu, G. (2020). A Framework of Virtual War Room and Matrix Sketch-Based Streaming Anomaly Detection for Microservice Systems. IEEE Access. https://doi.org/10.1109/access.2020.2977464
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.