A Framework of Virtual War Room and Matrix Sketch-Based Streaming Anomaly Detection for Microservice Systems
Open accessThe DOI matches its Crossref record; 32 of the 33 references it cites were found in a registry or an index.
Abstract
Recently, microservice has been a popular architecture to construct cloud-native systems. This novel architecture brings agility and accelerates the software development process significantly. However, it is not easy to manage and operate microservice systems due to their scale and complexity. Many approaches are proposed to automatically operate microservice systems such as anomaly detection. Nevertheless, those methods cannot be sufficiently validated and compared due to a lack of real microservice systems, which leads to the slow process of intelligent operation. These challenges inspire us to build a system named “VWR”, a framework of Virtual War Room for operating microservice applications which allows users to simulate their microservice architectures with low overhead and inject multiple types of faults into the microservice system with chaos engineering. VWR can mimic user requests and record the end-to-end tracing data (i.e., service call chains) for each request in a way consistent with OpenTracing. With easily designed tests and the produced streaming tracing data, the users can validate the performance of their intelligent operation algorithms and improve the algorithms as needed. Besides, based on the streaming tracing data generated by VWR, we introduce a novel unsupervised anomaly detection algorithm based on Matrix Sketch and set it as a default intelligent operation algorithm in VWR. This algorithm can detect anomalies by analyzing high-dimensional performance data collected from a microservice system in a streaming manner. The experimental result in VWR shows that the matrix sketch based method can precisely detect anomalies in microservice systems and outperform some widely used anomaly detection methods such as isolation forest in some scenario. We believe more approaches on the intelligent operation of microservice systems can be constructed based on VWR.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Other lightweight approaches include SVMs for API traffic [95], randomized matrix sketching for streaming data [118], and regression-based models such as Syslrn [70] that reduce data requirements through offline feature selection.”
From Anomaly detection and root-cause identification in microservices: a survey (2026) · cites this paper as [118]
Citations
Cites
Chandola, V., Banerjee, A., & Kumar, V. (2009) · ACM Computing Surveys · doi:10.1145/1541880.1541882 · Cited by 11,687 · cited 1×
“What is more, some other supervised approaches have been proposed for anomaly detection such as [26] and [27] which needs labeled data.”
BackgroundLiu, F. T., Ting, K. M., & Zhou, Z.-H. (2008) · 2008 Eighth IEEE International Conference on Data Mining · doi:10.1109/icdm.2008.17 · Cited by 6,601 · cited 3×
“The state-of-art approach IForest [25] is an efficient method that is not suitable for real-time scenarios.”
MethodZooKeeper: wait-free coordination for internet-scale systems
Hunt, P. G., Konar, M., Junqueira, F., & Reed, B. C. (2010) · USENIX Annual Technical Conference · Cited by 1,968
Anomaly Detection with Robust Deep Autoencoders
Zhou, C., & Paffenroth, R. C. (2017) · Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/3097983.3098052 · Cited by 1,436
Pinpoint: problem determination in large, dynamic Internet services
Chen, M. Y., Kiciman, E., Fratkin, E., Fox, A., & Brewer, E. (2003) · Proceedings International Conference on Dependable Systems and Networks · doi:10.1109/dsn.2002.1029005 · Cited by 835
Gan, Y., Zhang, Y., Cheng, D., Shetty, A., Rathi, P., Katarki, N., Bruno, A., Hu, J., Ritchken, B., Jackson, B., et al. (2019) · Proceedings of the Twenty-Fourth International Conference on Architectural Support for Programming Languages and Operating Systems · doi:10.1145/3297858.3304013 · Cited by 665
Using magpie for request extraction and workload modelling
Barham, P., Donnelly, A., Isaacs, R., & Mortier, R. (2004) · Operating Systems Design and Implementation · Cited by 559
X-trace: a pervasive network tracing framework
Fonseca, R., Porter, G., Katz, R. H., Shenker, S. J., & Stoica, I. G. (2007) · Cited by 438
Zhou, X., Peng, X., Xie, T., Sun, J., Ji, C., Li, W., & Ding, D. (2021) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2018.2887384 · Cited by 410
Path-based faliure and evolution management
Chen, M. Y., Accardi, A., Kıcıman, E., Lloyd, J., Patterson, D., Fox, A., & Brewer, E. (2004) · Networked Systems Design and Implementation · Cited by 302
Zhou, X., Peng, X., Xie, T., Sun, J., Ji, C., Liu, D., Xiang, Q., & He, C. (2019) · Proceedings of the 2019 27th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering · doi:10.1145/3338906.3338961 · Cited by 277
Hauswald, J., Laurenzano, M. A., Zhang, Y., Li, C., Rovinski, A., Khurana, A., Dreslinski, R. G., Mudge, T., Petrucci, V., Tang, L., et al. (2015) · Proceedings of the Twentieth International Conference on Architectural Support for Programming Languages and Operating Systems · doi:10.1145/2694344.2694347 · Cited by 193
Microscope: Pinpoint Performance Issues with Causal Graphs in Micro-service Environments
Lin, J., Chen, P., & Zheng, Z. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-03596-9_1 · Cited by 192
Self-citationCloudRanger: Root Cause Identification for Cloud Native Systems
Wang, P., Xu, J., Ma, M., Lin, W., Pan, D., Wang, Y., & Chen, P. (2018) · 2018 18th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (CCGRID) · doi:10.1109/ccgrid.2018.00076 · Cited by 181 · cited 1×
“Extensive studies have been done to resolve performance problems in distributed systems such as anomaly detection [6]–[8], root cause analysis [2], [9]–[11].”
BackgroundSelf-citationTailbench: a benchmark suite and evaluation methodology for latency-critical applications
Kasture, H., & Sanchez, D. (2016) · 2016 IEEE International Symposium on Workload Characterization (IISWC) · doi:10.1109/iiswc.2016.7581261 · Cited by 178
The mystery machine: end-to-end performance analysis of large-scale internet services
Chow, M., Meisner, D., Flinn, J., Peek, D., & Wenisch, T. F. (2014) · Operating Systems Design and Implementation · doi:10.5555/2685048.2685066 · Cited by 166
Diagnosing performance changes by comparing request flows
Sambasivan, R. R., Zheng, A. X., Rosa, M. D., Krevat, E., Whitman, S., Stroucken, M., Wang, W. Y., Xu, L., & Ganger, G. R. (2011) · doi:10.5555/1972457.1972463 · Cited by 165
BigHouse: A simulation infrastructure for data center systems
Meisner, D., Wu, J., & Wenisch, T. F. (2012) · IEEE International Symposium on Performance Analysis of Systems and Software (ISPASS) · doi:10.1109/ispass.2012.6189204 · Cited by 143
Chen, P., Qi, Y., Zheng, P., & Hou, D. (2014) · IEEE INFOCOM 2014 - IEEE Conference on Computer Communications · doi:10.1109/infocom.2014.6848128 · Cited by 140
Self-citationMicroscaler: Automatic Scaling for Microservices with an Online Learning Approach
Yu, G., Chen, P., & Zheng, Z. (2019) · IEEE International Conference on Web Services (ICWS) · doi:10.1109/icws.2019.00023 · Cited by 107
Self-citationAlgorithms for the QR-Decomposition
Gander, W. (2003) · Cited by 84
Anomaly detection and diagnosis for cloud services: Practical experiments and lessons learned
Sauvanaud, C., Kaâniche, M., Kanoun, K., Lazri, K., & Silvestre, G. (2018) · Journal of Systems and Software · doi:10.1016/j.jss.2018.01.039 · Cited by 81
PerfAugur: Robust diagnostics for performance anomalies in cloud services
Roy, S., König, A. C., Dvorkin, I., & Kumar, M. (2015) · IEEE International Conference on Data Engineering (ICDE) · doi:10.1109/icde.2015.7113365 · Cited by 61
Detailed diagnosis in enterprise networks
Kandula, S., Mahajan, R., Verkaik, P., Agarwal, S., Padhye, J. D., & Bahl, P. (2009) · ACM SIGCOMM Computer Communication Review · doi:10.1145/1594977.1592597 · Cited by 56
Clearing the clouds: a study of emerging scale-out workloads on modern hardware
Ferdman, M., Adileh, A., Kocberber, O., Volos, S., Alisafaee, M., Jevdjic, D., Kaynak, C., Popescu, A. D., Ailamaki, A., & Falsafi, B. (2012) · ACM SIGARCH Computer Architecture News · doi:10.1145/2189750.2150982 · Cited by 55
Streaming anomaly detection using randomized matrix sketching
Huang, H., & Kasiviswanathan, S. P. (2015) · Proceedings of the VLDB Endowment · doi:10.14778/2850583.2850593 · Cited by 47
LAMP lights enterprise development efforts
Lawton, G. (2005) · Computer · doi:10.1109/mc.2005.304 · Cited by 46
Real-Time I/O-Monitoring of HPC Applications with SIOX, Elasticsearch, Grafana and FUSE
Betke, E., & Kunkel, J. M. (2017) · Lecture notes in computer science · doi:10.1007/978-3-319-67630-2_15 · Cited by 32
Chang, M. A., Tschaen, B., Benson, T., & Vanbever, L. (2015) · ACM Special Interest Group on Data Communication · doi:10.1145/2785956.2790038 · Cited by 29
ARF-Predictor: Effective Prediction of Aging-Related Failure Using Entropy
Chen, P., Qi, Y., Li, X., Hou, D., & Lyu, M. R.-T. (2016) · IEEE Transactions on Dependable and Secure Computing · doi:10.1109/tdsc.2016.2604381 · Cited by 26
Self-citationDiagnosing Performance Variations by Comparing Multi-Level Execution Traces
Doray, F. P., & Dagenais, M. (2016) · IEEE Transactions on Parallel and Distributed Systems · doi:10.1109/tpds.2016.2567390 · Cited by 20
Seer: Leveraging Big Data to Navigate the Increasing Complexity of Cloud DebuggingPreprint
Gan, Y., Pancholi, M., Cheng, D., Hu, S., He, Y., & Delimitrou, C. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1804.09136 · Cited by 3
Research works printed but not linked: 14
- 2018, Filebeat
- cohen, 2013, Announcing Zuul Edge Service in the Cloud
- ranganathan, 2012, Netflix shares cloud load balancing and failover tool Eureka!
- gormley, 2015, Elasticsearch The Definitive Guide A Distributed Real-Time Search and Analytics Engine
- 2018, Socks Shop—A Microservices Demo Application
- bennett, 2012, Chaos Monkey Released Into The Wild
- 2019, Istio
- zhang, 2019, $\mu$ qSim: Enabling accurate and scalable simulation for interactive microservices, Proc IEEE Int Symp Perform Anal Syst Softw (ISPASS), 212
- 2019, Zipkin Homepage
- cockcroft, 2016, The evolution of microservices, Proc ACM Learn Webinar, 1
- cockroft, 2016, Microservices: Why, what, and how to get there, Microservices Workshop All Topics Deck
- reynolds, 2016, Vizceral Open Source
- aggarwal, 2016, Outlier Analysis
- 2019, Zipkin Span
Cited by
Soldani, J., & Brogi, A. (2023) · ACM Computing Surveys · doi:10.1145/3501297 · Cited by 256
“An alternative approach to machine learning is trace comparison, which is enacted by Chen et al. [17], Meng et al. [54], and Wang et al. [88], all based on instrumenting applications to feature distributed tracing.”
BackgroundMethodInfluentialReview of Anomaly Detection Algorithms for Data Streams
Lu, T., Wang, L., & Zhao, X. (2023) · Applied Sciences · doi:10.3390/app13106353 · Cited by 100
On Microservice Analysis and Architecture Evolution: A Systematic Mapping Study
Bushong, V., Abdelfattah, A. S., Maruf, A. A., Das, D., Lehman, A., Jaroszewski, E., Coffey, M., Cerny, T., Frajták, K., Tisnovsky, P., et al. (2021) · Applied Sciences · doi:10.3390/app11177856 · Cited by 116
Microservice security: a systematic literature review
Berardi, D., Giallorenzo, S., Mauro, J., Melis, A., Montesi, F., & Prandini, M. (2022) · PeerJ Computer Science · doi:10.7717/peerj-cs.779 · Cited by 94
TraceGra: A trace-based anomaly detection for microservice using graph deep learning
Chen, J., Liu, F., Jiang, J., Zhong, G., Xu, D., Tan, Z., & Shi, S. (2023) · Computer Communications · doi:10.1016/j.comcom.2023.03.028 · Cited by 55
Metadata
- Authors
- Chen, H., Chen, P., & Yu, G.
- Affiliations
- Sun Yat-sen University (CN)
- Venue
- IEEE Access
- Published
- 2020
- Volume
- 8
- Pages
- 43413-43426
- ISSN
- 2169-3536 (ISSN-L)
- OpenAlex
- W3009134255
- Cited by
- 36
- References
- 33
- Citations by year
- 2026: 5 · 2025: 6 · 2024: 1 · 2023: 6 · 2022: 11 · 2021: 5 · 2020: 2
- FWCI
- 2.82
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Locations
- IEEE Access (publishedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- National Key Research and Development Plan (2019YFB1804002)
- National Natural Science Foundation of China (61802448, 6190244, U1811462)
- Natural Science Foundation of Guangdong Province (2019A1515012229)
- Topics
- Physical Sciences › Computer Science › Computer Networks and Communications › Software System Performance and Reliability
- Physical Sciences › Computer Science › Artificial Intelligence › Anomaly Detection Techniques and Applications
- Physical Sciences › Computer Science › Information Systems › Cloud Computing and Resource Management
- Keywords
- microservices, anomaly detection, chaos engineering, fault injection, streaming anomaly detection, intelligent operation, cloud-native systems, unsupervised anomaly detection
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.