PreprintCited by 6Anomaly Detection Techniques and ApplicationsTime Series Analysis and ForecastingAdvanced Graph Neural Networks

Event2Graph: Event-driven Bipartite Graph for Multivariate Time-series Anomaly Detection

Open access
Wu, Yuhang, Gu, Mengting, Wang, Lan, Lin, Yusan, Wang, Fei, Yang, Hao·2021·arXiv

Abstract

Modeling inter-dependencies between time-series is the key to achieve high performance in anomaly detection for multivariate time-series data. The de-facto solution to model the dependencies is to feed the data into a recurrent neural network (RNN). However, the fully connected network structure underneath the RNN (either GRU or LSTM) assumes a static and complete dependency graph between time-series, which may not hold in many real-world applications. To alleviate this assumption, we propose a dynamic bipartite graph structure to encode the inter-dependencies between time-series. More concretely, we model time series as one type of nodes, and the time series segments (regarded as event) as another type of nodes, where the edge between two types of nodes describe a temporal pattern occurred on a specific time series at a certain time. Based on this design, relations between time series can be explicitly modelled via dynamic connections to event nodes, and the multivariate time-series anomaly detection problem can be formulated as a self-supervised, edge stream prediction problem in dynamic graphs. We conducted extensive experiments to demonstrate the effectiveness of the design.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

DataCite · 10.48550/arxiv.2108.06783

Cites

1 of 1 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • By using sparse and variational autoencoder architectures, TVGeAN can capture intrinsic knowledge from a small training space and generalize it effectively without using complex approaches.

    “Furthermore, by using sparse and variational autoencoder architectures, TVGeAN can capture the intrinsic knowledge from a small training space and generalize it effectively without using complex approaches, as is the case with the models that use the dynamic graph approach, e.g., refs.[103-106].”
  • Table 3 shows that some models such as [76,77,104,106] have adopted the principles of the dynamic graph approach to construct graphs at runtimes based on the dynamics represented in the MTSs.

    “Table 3 also shows that some models such as [76,77,104,106] have adopted the principles of the dynamic graph approach to endow the DNN models with the ability to construct the graphs at runtimes based on the dynamics represented in the MTSs.”

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Research works printed but not linked: 28

  1. [1][1] Berndt, D. J., and Clifford, J. Using dynamic time warping to find patterns in time series. In Knowledge Discovery in Databases: Papers from the 1994 AAAI Workshop, Seattle, Washington, USA, July 1994. Technical Report WS-94-03 (1994), U. M. Fayyad and R. Uthurusamy, Eds., AAAI Press, pp. 359-370. -
  2. [2][2] Cheng, Z., Yang, Y., Wang, W., Hu, W., Zhuang, Y., and Song, G. Time2graph: Revisiting time series modeling with dynamic shapelets. In The Thirty-Fourth AAAI Conference on Artificial Intelligence, AAAI 2020, The Thirty-Second Innovative Applications of Artificial Intelligence Conference, IAAI 2020, The Tenth AAAI Symposium on Educational Advances in Artificial Intelligence, EAAI 2020, New York, NY, USA, February 7-12, 2020 (2020), AAAI Press, pp. 3617-3624. -
  3. [3][3] Chung, J., Gülçehre, Ç., Cho, K., and Bengio, Y. Empirical evaluation of gated recurrent neural networks on sequence modeling. CoRR abs/1412.3555 (2014). - · arXiv
  4. [4][4] Deng, A., and Hooi, B. Graph neural network-based anomaly detection in multivariate time series. In Proceedings of the 35th AAAI Conference on Artificial Intelligence, Vancouver, BC, Canada (2021), pp. 2-9. -
  5. [5][5] Hochreiter, S., and Schmidhuber, J. Long short-term memory. Neural Comput. 9 , 8 (1997), 1735-1780. -
  6. [6][6] Hu, W., Yang, Y., Cheng, Z., Yang, C., and Ren, X. Time-series event prediction with evolutionary state graph. In WSDM '21, The Fourteenth ACM International Conference on Web Search and Data Mining, Virtual Event, Israel, March 8-12, 2021 (2021), L. Lewin-Eytan, D. Carmel, E. Yom-Tov, E. Agichtein, and E. Gabrilovich, Eds., ACM, pp. 580-588. -
  7. [7][7] Hundman, K., Constantinou, V., Laporte, C., Colwell, I., and Söderström, T. Detecting spacecraft anomalies using lstms and nonparametric dynamic thresholding. In Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, KDD 2018, London, UK, August 19-23, 2018 (2018), Y. Guo and F. Farooq, Eds., ACM, pp. 387-395. -
  8. [8][8] Kumar, S., Zhang, X., and Leskovec, J. Predicting dynamic embedding trajectory in temporal interaction networks. In Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, KDD 2019, Anchorage, AK, USA, August 4-8, 2019 (2019), A. Teredesai, V. Kumar, Y. Li, R. Rosales, E. Terzi, and G. Karypis, Eds., ACM, pp. 1269-1278. -
  9. [9][9] Malhotra, P., Ramakrishnan, A., Anand, G., Vig, L., Agarwal, P., and Shroff, G. Lstm-based encoder-decoder for multi-sensor anomaly detection. CoRR abs/1607.00148 (2016). - · arXiv
  10. [10][10] McInnes, L., Healy, J., and Astels, S. hdbscan: Hierarchical density based clustering. J. Open Source Softw. 2 , 11 (2017), 205. -
  11. [12][12] Nguyen, G. H., Lee, J. B., Rossi, R. A., Ahmed, N. K., Koh, E., and Kim, S. Dynamic network embeddings: From random walks to temporal random walks. In IEEE International Conference on Big Data, Big Data 2018, Seattle, WA, USA, December 10-13, 2018 (2018), N. Abe, H. Liu, C. Pu, X. Hu, N. K. Ahmed, M. Qiao, Y. Song, D. Kossmann, B. Liu, K. Lee, J. Tang, J. He, and J. S. Saltz, Eds., IEEE, pp. 1085-1092. -
  12. [13][13] Park, D., Hoshi, Y., and Kemp, C. C. A multimodal anomaly detector for robotassisted feeding using an lstm-based variational autoencoder. IEEE Robotics and Automation Letters 3 , 3 (2018), 1544-1551. -
  13. [14][14] Rossi, E., Chamberlain, B., Frasca, F., Eynard, D., Monti, F., and Bronstein, M. Temporal graph networks for deep learning on dynamic graphs. arXiv preprint arXiv:2006.10637 (2020). - · arXiv
  14. [15][15] Rossi, E., Chamberlain, B., Frasca, F., Eynard, D., Monti, F., and Bronstein, M. M. Temporal graph networks for deep learning on dynamic graphs. CoRR abs/2006.10637 (2020). - · arXiv
  15. [16][16] Sankar, A., Wu, Y., Gou, L., Zhang, W., and Yang, H. Dysat: Deep neural representation learning on dynamic graphs via self-attention networks. In WSDM '20: The Thirteenth ACM International Conference on Web Search and Data Mining, Houston, TX, USA, February 3-7, 2020 (2020), J. Caverlee, X. B. Hu, M. Lalmas, and W. Wang, Eds., ACM, pp. 519-527. -
  16. [17][17] Shen, L., Li, Z., and Kwok, J. T. Timeseries anomaly detection using temporal hierarchical one-class network. In Advances in Neural Information Processing Systems 33: Annual Conference on Neural Information Processing Systems 2020, NeurIPS 2020, December 6-12, 2020, virtual (2020), H. Larochelle, M. Ranzato, R. Hadsell, M. Balcan, and H. Lin, Eds. -
  17. [18][18] Siffer, A., Fouqe, P.-A., Termier, A., and Largouet, C. Anomaly detection in streams with extreme value theory. In Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (2017), pp. 10671075. -
  18. [20][20] Su, Y., Zhao, Y., Niu, C., Liu, R., Sun, W., and Pei, D. Robust anomaly detection for multivariate time series through stochastic recurrent neural network. In Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining (2019), pp. 2828-2837. -
  19. [21][21] Trivedi, R., Farajtabar, M., Biswal, P., and Zha, H. Dyrep: Learning representations over dynamic graphs. In 7th International Conference on Learning Representations, ICLR 2019, New Orleans, LA, USA, May 6-9, 2019 (2019), OpenReview.net. -
  20. [22][22] Velickovic, P., Cucurull, G., Casanova, A., Romero, A., Liò, P., and Bengio, Y. Graph attention networks. In 6th International Conference on Learning Representations, ICLR 2018, Vancouver, BC, Canada, April 30 - May 3, 2018, Conference Track Proceedings (2018), OpenReview.net. -
  21. [23][23] Xu, D., Ruan, C., Körpeoglu, E., Kumar, S., and Achan, K. Inductive representation learning on temporal graphs. In 8th International Conference on Learning Representations, ICLR 2020, Addis Ababa, Ethiopia, April 26-30, 2020 (2020), OpenReview.net. -
  22. [24][24] Yeh, C. M., Zhu, Y., Ulanova, L., Begum, N., Ding, Y., Dau, H. A., Silva, D. F., Mueen, A., and Keogh, E. J. Matrix profile I: all pairs similarity joins for time , , series: A unifying view that includes motifs, discords and shapelets. In IEEE 16th International Conference on Data Mining, ICDM 2016, December 12-15, 2016, Barcelona, Spain (2016), F. Bonchi, J. Domingo-Ferrer, R. Baeza-Yates, Z. Zhou, and X. Wu, Eds., IEEE Computer Society, pp. 1317-1322. -
  23. [25][25] Yu, W., Cheng, W., Aggarwal, C. C., Chen, H., and Wang, W. Link prediction with spatial and temporal consistency in dynamic networks. In Proceedings of the Twenty-Sixth International Joint Conference on Artificial Intelligence, IJCAI 2017, Melbourne, Australia, August 19-25, 2017 (2017), C. Sierra, Ed., ijcai.org, pp. 3343-3349. -
  24. [26][26] Yu, W., Cheng, W., Aggarwal, C. C., Zhang, K., Chen, H., and Wang, W. Netwalk: A flexible deep embedding approach for anomaly detection in dynamic networks. In Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, KDD 2018, London, UK, August 19-23, 2018 (2018), Y. Guo and F. Farooq, Eds., ACM, pp. 2672-2681. -
  25. [27][27] Zhang, Y., Ge, Z., Greenberg, A. G., and Roughan, M. Network anomography. In Proceedings of the 5th Internet Measurement Conference, IMC 2005, Berkeley, California, USA, October 19-21, 2005 (2005), USENIX Association, pp. 317-330. -
  26. [28][28] Zhao, H., Wang, Y., Duan, J., Huang, C., Cao, D., Tong, Y., Xu, B., Bai, J., Tong, J., and Zhang, Q. Multivariate time-series anomaly detection via graph attention network. In 20th IEEE International Conference on Data Mining, ICDM 2020, Sorrento, Italy, November 17-20, 2020 (2020), C. Plant, H. Wang, A. Cuzzocrea, C. Zaniolo, and X. Wu, Eds., IEEE, pp. 841-850. -
  27. [29][29] Zhu, Y., Yeh, C. M., Zimmerman, Z., Kamgar, K., and Keogh, E. J. Matrix profile XI: SCRIMP++: time series motif discovery at interactive speeds. In IEEE International Conference on Data Mining, ICDM 2018, Singapore, November 17-20, 2018 (2018), IEEE Computer Society, pp. 837-846. -
  28. [30][30] Zong, B., Song, Q., Min, M. R., Cheng, W., Lumezanu, C., Cho, D., and Chen, H. Deep autoencoding gaussian mixture model for unsupervised anomaly detection. In 6th International Conference on Learning Representations, ICLR 2018, Vancouver, BC, Canada, April 30 - May 3, 2018, Conference Track Proceedings (2018), OpenReview.net.

Authors
Wu, Y., Gu, M., Wang, L., Lin, Y., Wang, F., & Yang, H.
Venue
arXiv
Publisher
arXiv
Published
2021
ISSN
2331-8422 (ISSN-L)
OpenAlex
W3196238440
Cited by
6
References
1
Citations by year
2025: 1 · 2024: 2 · 2022: 2 · 2021: 1
Type
posted content
Language
en
Open access
Locations
  • arXiv (Cornell University) (submittedVersion)
  • arXiv (Cornell University) (cc-by)
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Anomaly Detection Techniques and Applications
  • Physical Sciences › Computer Science › Signal Processing › Time Series Analysis and Forecasting
  • Physical Sciences › Computer Science › Artificial Intelligence › Advanced Graph Neural Networks
Keywords
multivariate time series anomaly detection, bipartite graphs, dynamic graph neural networks, self-supervised learning, temporal patterns, recurrent neural networks

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review