CoChat

A Spatiotemporal Deep Learning Approach for Unsupervised Anomaly Detection in Cloud Systems

He, Zilong, Chen, Pengfei, Li, Xiaoyun, Wang, Yongfeng, Yu, Guangba, Chen, Cailin, Li, Xinrui, Zheng, Zibin · 2023 · IEEE Transactions on Neural Networks and Learning Systems
Cited by 148

The DOI matches its Crossref record; 24 of the 24 references it cites were found in a registry or an index.

Abstract

Anomaly detection is a critical task for maintaining the performance of a cloud system. Using data-driven methods to address this issue is the mainstream in recent years. However, due to the lack of labeled data for training in practice, it is necessary to enable an anomaly detection model trained on contaminated data in an unsupervised way. Besides, with the increasing complexity of cloud systems, effectively organizing data collected from a wide range of components of a system and modeling spatiotemporal dependence among them become a challenge. In this article, we propose TopoMAD, a stochastic seq2seq model which can robustly model spatial and temporal dependence among contaminated data. We include system topological information to organize metrics from different components and apply sliding windows over metrics collected continuously to capture the temporal dependence. We extract spatial features with the help of graph neural networks and temporal features with long short-term memory networks. Moreover, we develop our model based on variational auto-encoder, enabling it to work well robustly even when trained on contaminated data. Our approach is validated on the run-time performance data collected from two representative cloud systems, namely, a big data batch processing system and a microservice-based transaction processing system. The experimental results show that TopoMAD outperforms some state-of-the-art methods on these two data sets.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1109/tnnls.2020.3027736

Cites

24 of 24 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 24 references

Research works printed but not linked: 55

  1. 10.1145/3097983.3098144 · DOI · Paper page
  2. 10.1145/3178876.3185996 · DOI · Paper page
  3. 10.1109/PCCC.2018.8710885 · DOI · Paper page
  4. 10.1109/INFOCOM.2019.8737430 · DOI
  5. 10.1109/BigData.Congress.2013.60 · DOI · Paper page
  6. Malhotra, Long short term memory networks for anomaly detection in time series, 89
  7. 10.1609/aaai.v33i01.33011409 · DOI · Paper page
  8. An, 2015, Variational autoencoder based anomaly detection using reconstruction probability, Special Lect. IE, 2, 1
  9. 10.1109/TNNLS.2020.2980749 · DOI · Paper page
  10. Kingma, Auto-encoding variational Bayes, 1
  11. Kipf, Semi-supervised classification with graph convolutional networks, 1
  12. Veličković, Graph attention networks, 1
  13. 10.1162/089976600300015015 · DOI · Paper page
  14. Schölkopf, Support vector method for novelty detection, 582
  15. 10.1007/3-540-46145-0_17 · DOI · Paper page
  16. 10.1007/978-3-642-35527-1_60 · DOI
  17. 10.1109/COMPSACW.2013.28 · DOI
  18. 10.1145/1807128.1807161 · DOI · Paper page
  19. 10.1109/INFOCOM.2014.6848128 · DOI · Paper page
  20. 10.1145/3236024.3236060 · DOI · Paper page
  21. 10.1145/3317550.3321438 · DOI · Paper page
  22. Vallis, A novel technique for long-term anomaly detection in the cloud, 15
  23. 10.1109/NOMS.2010.5488443 · DOI · Paper page
  24. 10.1109/ISSRE.2016.21 · DOI · Paper page
  25. Khadke, Transparent system call based performance debugging for cloud computing
  26. 10.1109/TCC.2015.2415813 · doi:10.1109/tcc.2015.2415813
  27. 10.1145/3297858.3304004 · DOI · Paper page
  28. 10.1109/DSN.2013.6575304 · DOI
  29. 10.1109/BigData.2013.6691701 · doi:10.1109/bigdata.2013.6691701
  30. 10.1145/2939672.2939765 · DOI
  31. 10.1109/TSC.2011.42 · DOI
  32. 10.1109/CLUSTER.2018.00039 · DOI
  33. Li, Diffusion convolutional recurrent neural network: Data-driven traffic forecasting, 1
  34. 10.24963/ijcai.2018/505 · DOI · Paper page
  35. Barham, Using magpie for request extraction and workload modelling, 4, 18
  36. Fonseca, X-trace: A pervasive network tracing framework, 271
  37. Chen, Automating network application dependency discovery: Experiences, limitations, and new solutions, 8, 117
  38. 10.1109/IC2E.2014.86 · doi:10.1109/ic2e.2014.86
  39. 10.1146/annurev.neuro.26.041002.131047 · DOI · Paper page
  40. Vaswani, Attention is all you need, 5998
  41. 10.1007/978-3-319-46448-0_8 · DOI · Paper page
  42. 10.1162/tacl_a_00049 · DOI · Paper page
  43. 10.1007/978-1-4757-4145-2 · DOI · Paper page
  44. Sutskever, Sequence to sequence learning with neural networks, 3104
  45. 10.1109/ICDEW.2010.5452747 · DOI · Paper page
  46. 2020, HDFS-448
  47. 2020, HDFS-8160
  48. 2020, Telegraf
  49. 2020, Cloudwatch
  50. 2019, Hipster Shop: Cloud-Native Microservices Demo Application
  51. 2019, Kubernetes
  52. Fey, 2019, Fast graph representation learning with PyTorch geometric
  53. Frazier, 2018, A tutorial on Bayesian optimization
  54. 10.1145/3292500.3330925 · DOI · Paper page
  55. 10.1007/978-3-030-03596-9_1 · DOI · Paper page

Cited by

See all 148

Metadata

Authors
He, Z., Chen, P., Li, X., Wang, Y., Yu, G., Chen, C., Li, X., & Zheng, Z.
Venue
IEEE Transactions on Neural Networks and Learning Systems
Published
2023-04
Volume
34
Issue
4
Pages
1705-1719
ISSN
  • 2162-237X (ISSN-L)
  • 2162-2388
OpenAlex
W3093074257
Cited by
148
References
24
FWCI
6.48
Type
journal article
Language
en
Open access
closed
Funders
  • National Key Research and Development Program of China (2019YFB1804002)
  • Research Development Plan of Key Areas in Guangdong Province (2020B010165002)
  • Natural Science Foundation of China (U1811462, 61802448)
  • Basic and Applied Basic Research of Guangzhou (202002030328)
  • Natural Science Foundation of Guangdong Province (2019A1515012229)

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: A Spatiotemporal Deep Learning Approach for Unsupervised Anomaly Detection in Cloud Systems. https://app.cochat.ai/papers/10.1109/tnnls.2020.3027736
The paper
He, Z., Chen, P., Li, X., Wang, Y., Yu, G., Chen, C., Li, X., & Zheng, Z. (2023). A Spatiotemporal Deep Learning Approach for Unsupervised Anomaly Detection in Cloud Systems. IEEE Transactions on Neural Networks and Learning Systems. https://doi.org/10.1109/tnnls.2020.3027736

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.