Multivariate Time Series Anomaly Detection and Interpretation using Hierarchical Inter-Metric and Temporal Embedding
The DOI matches its Crossref record; 28 of the 28 references it cites were found in a registry or an index.
Abstract
Anomaly detection is a crucial task for monitoring various status (i.e., metrics) of entities (e.g., manufacturing systems and Internet services), which are often characterized by multivariate time series (MTS). In practice, it's important to precisely detect the anomalies, as well as to interpret the detected anomalies through localizing a group of most anomalous metrics, to further assist the failure troubleshooting. In this paper, we propose InterFusion, an unsupervised method that simultaneously models the inter-metric and temporal dependency for MTS. Its core idea is to model the normal patterns inside MTS data through hierarchical Variational AutoEncoder with two stochastic latent variables, each of which learns low-dimensional inter-metric or temporal embeddings. Furthermore, we propose an MCMC-based method to obtain reasonable embeddings and reconstructions at anomalous parts for MTS anomaly interpretation. Our evaluation experiments are conducted on four real-world datasets from different industrial domains (three existing and one newly published dataset collected through our pilot deployment of InterFusion). InterFusion achieves an average anomaly detection F1-Score higher than 0.94 and anomaly interpretation performance of 0.87, significantly outperforming recent state-of-the-art MTS anomaly detection methods.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The representation learning method based on VAE can model the distribution of each time step to better capture the complex spatiotemporal dependencies and provide better interpretability in time series modeling tasks.”
From Self-Supervised Learning for Time Series Analysis: Taxonomy, Progress, and Prospects (2024) · cites this paper as [80]
Citations
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
Advances in neural information processing systems 7
(1996) · Computers & Mathematics with Applications · doi:10.1016/s0898-1221(96)90463-0 · Cited by 14,281
Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling
Chung, J., Gulcehre, C., Cho, K., & Bengio, Y. (2014) · arXiv · doi:10.48550/arxiv.1412.3555 · Cited by 11,008
Robust Anomaly Detection for Multivariate Time Series through Stochastic Recurrent Neural Network
Su, Y., Zhao, Y., Niu, C., Liu, R., Sun, W., & Pei, D. (2019) · Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining · doi:10.1145/3292500.3330672 · Cited by 1,804 · cited 10×
“However, previous works [2, 14, 19, 30, 34] mainly model one of the dependencies ( e.g. , intermetric dependency, through latent metric embedding), which could limit their capability on learning normal MTS patterns and detecting anomalies , especially those violating the other kind of dependency (…”
BackgroundMethodInfluentialSelf-citationDetecting Spacecraft Anomalies Using LSTMs and Nonparametric Dynamic Thresholding
Hundman, K., Constantinou, V., Laporte, C., Colwell, I., & Soderstrom, T. (2018) · Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining · doi:10.1145/3219819.3219845 · Cited by 1,771 · cited 9×
“LSTM-NDT [14] comes from the authors’ implementation on https: //github.com/khundman/telemanom.”
BackgroundMethodInfluentialInternational Conference on Learning Representations (ICLR)
Abbas, M. Z. A., Kivinen, J., & Raiko, T. (2016) · Cited by 1,694
Scheduled Sampling for Sequence Prediction with Recurrent Neural Networks
Bengio, S., Vinyals, O., Jaitly, N., & Shazeer, N. (2015) · arXiv · doi:10.48550/arxiv.1506.03099 · Cited by 1,621
Bayesian Inference in Econometric Models Using Monte Carlo Integration
Geweke, J. (1989) · Econometrica · doi:10.2307/1913710 · Cited by 1,563
Deep Learning for Anomaly Detection: A Survey
Chalapathy, R., & Chawla, S. (2019) · arXiv · doi:10.48550/arxiv.1901.03407 · Cited by 1,240 · cited 1×
“Anomaly detection has been widely studied in different domains [5] (e.”
BackgroundMAD-GAN: Multivariate Anomaly Detection for Time Series Data with Generative Adversarial Networks
Li, D., Chen, D., Jin, B., Shi, L., Goh, J., & Ng, S.-K. (2019) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-30490-4_56 · Cited by 1,185
A Multimodal Anomaly Detector for Robot-Assisted Feeding Using an LSTM-Based Variational Autoencoder
Park, D., Hoshi, Y., & Kemp, C. C. (2018) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2018.2801475 · Cited by 1,115
USAD: UnSupervised Anomaly Detection on Multivariate Time Series
Audibert, J., Michiardi, P., Guyard, F., Marti, S., & Zuluaga, M. A. (2020) · Proceedings of the 26th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining · doi:10.1145/3394486.3403392 · Cited by 1,094 · cited 9×
“Thus, we adopt the point-adjust approach, which is proposed by [33] and widely used in the evaluation of detection tasks [2, 23, 27, 30].”
BackgroundMethodInfluentialSWaT: a water treatment testbed for research and training on ICS security
Mathur, A. P., & Tippenhauer, N. O. (2016) · 2016 International Workshop on Cyber-physical Systems for Smart Water Networks (CySWater) · doi:10.1109/cyswater.2016.7469060 · Cited by 878
A Unifying Review of Linear Gaussian Models
Roweis, S., & Ghahramani, Z. (1999) · Neural Computation · doi:10.1162/089976699300016674 · Cited by 869
Zhang, C., Song, D., Chen, Y., Feng, X., Lumezanu, C., Cheng, W., Ni, J., Zong, B., Chen, H., & Chawla, N. V. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33011409 · Cited by 855
LSTM-based Encoder-Decoder for Multi-sensor Anomaly Detection
Malhotra, P., Ramakrishnan, A., Anand, G., Vig, L., Agarwal, P., & Shroff, G. (2016) · arXiv · doi:10.48550/arxiv.1607.00148 · Cited by 819 · cited 4×
“…has been an active research topic in the SIGKDD community these years [2, 14, 30], and is widely used to monitor the status ( i.e. , metrics) of entities ( e.g. , systems, services) in the application domain of manufacturing industry and Information Technology (IT) systems [14, 19, 20, 22, 30, 34].”
BackgroundMethodInfluentialUnsupervised Anomaly Detection via Variational Auto-Encoder for Seasonal KPIs in Web Applications
Xu, H., Feng, Y., Chen, J., Wang, Z., Qiao, H., Chen, W., Zhao, N., Li, Z., Bu, J., Li, Z., et al. (2018) · Proceedings of the 2018 World Wide Web Conference on World Wide Web - WWW '18 · doi:10.1145/3178876.3185996 · Cited by 808
Self-citationKim, J.-H., Jun, J., & Zhang, B.-T. (2018) · arXiv · doi:10.48550/arxiv.1805.07932 · Cited by 761
On the evaluation of unsupervised outlier detection: measures, datasets, and an empirical study
Campos, G. O., Zimek, A., Sander, J., Campello, R. J. G. B., Micenková, B., Schubert, E., Assent, I., & Houle, M. E. (2016) · Data Mining and Knowledge Discovery · doi:10.1007/s10618-015-0444-8 · Cited by 735
Time-Series Anomaly Detection Service at Microsoft
Ren, H., Xu, B., Wang, Y., Yi, C., Huang, C., Kou, X., Xing, T., Yang, M., Tong, J., & Zhang, Q. (2019) · Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining · doi:10.1145/3292500.3330680 · Cited by 623
Atkinson, A. C., & Hawkins, D. M. (1981) · Biometrics · doi:10.2307/2530182 · Cited by 560
Training and testing of recommender systems on data missing not at random
Steck, H. (2010) · Proceedings of the 16th ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/1835804.1835895 · Cited by 365
DSANet: Dual Self-Attention Network for Multivariate Time Series Forecasting
Huang, S., Wang, D., Wu, X., & Tang, A. (2019) · Proceedings of the 28th ACM International Conference on Information and Knowledge Management · doi:10.1145/3357384.3358132 · Cited by 250
Locality-Sensitive Deconvolution Networks with Gated Fusion for RGB-D Indoor Semantic Segmentation
Cheng, Y., Cai, R., Li, Z., Zhao, X., & Huang, K. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.161 · Cited by 229
Self-citationFrom neural PCA to deep unsupervised learning
Valpola, H. (2015) · Advances in Independent Component Analysis and Learning Machines · doi:10.1016/b978-0-12-802806-3.00008-7 · Cited by 181
Advances in Independent Component Analysis and Learning Machines
Bingham, E., Samuel Kaski, A., Laaksonen, J. T., Lampinen, J., & Oja, E. (2015) · Elsevier eBooks · doi:10.1016/c2014-0-02754-2 · Cited by 41
Hawkins, D. M. (1980) · Identification of Outliers · doi:10.1007/978-94-015-3994-4_5
Research works printed but not linked: 8
- Jinwon An and Sungzoon Cho . 2015 . Variational autoencoder based anomaly detection using reconstruction probability . Special Lecture on IE , Vol. 2 , 1 (2015). Jinwon An and Sungzoon Cho. 2015. Variational autoencoder based anomaly detection using reconstruction probability. Special Lecture on IE, Vol. 2, 1 (2015).
- Yasuhiro Ikeda , Kengo Tajiri , Yuusuke Nakano , Keishiro Watanabe , and Keisuke Ishibashi . 2019 . Estimation of dimensions contributing to detected anomalies with variational autoencoders . Proceedings of the AAAI Conference on Artificial Intelligence, Workshop on Network Interpretability for Deep Learning (2019). Yasuhiro Ikeda, Kengo Tajiri, Yuusuke Nakano, Keishiro Watanabe, and Keisuke Ishibashi. 2019. Estimation of dimensions contributing to detected anomalies with variational autoencoders. Proceedings of the AAAI Conference on Artificial Intelligence, Workshop on Network Interpretability for Deep Learning (2019).
- Diederik P Kingma and Max Welling . 2014 . Auto-encoding variational bayes . 2nd International Conference on Learning Representations (ICLR) (2014). Diederik P Kingma and Max Welling. 2014. Auto-encoding variational bayes. 2nd International Conference on Learning Representations (ICLR) (2014).
- Danilo Rezende and Shakir Mohamed . 2015 . Variational Inference with Normalizing Flows. In International Conference on Machine Learning. 1530--1538 . Danilo Rezende and Shakir Mohamed. 2015. Variational Inference with Normalizing Flows. In International Conference on Machine Learning. 1530--1538.
- Danilo Jimenez Rezende , Shakir Mohamed , and Daan Wierstra . 2014 . Stochastic backpropagation and approximate inference in deep generative models . Proceedings of the 31st International Conference on Machine Learning , Vol. 32 (2014), II--1278. Danilo Jimenez Rezende, Shakir Mohamed, and Daan Wierstra. 2014. Stochastic backpropagation and approximate inference in deep generative models. Proceedings of the 31st International Conference on Machine Learning, Vol. 32 (2014), II--1278.
- Lifeng Shen , Zhuocong Li , and James Kwok . 2020 . Timeseries Anomaly Detection using Temporal Hierarchical One-Class Network . Advances in Neural Information Processing Systems , Vol. 33 (2020). Lifeng Shen, Zhuocong Li, and James Kwok. 2020. Timeseries Anomaly Detection using Temporal Hierarchical One-Class Network. Advances in Neural Information Processing Systems, Vol. 33 (2020).
- Casper Kaae Sønderby Tapani Raiko etal 2016. Ladder variational autoencoders. In Advances in neural information processing systems. 3738--3746. Casper Kaae Sønderby Tapani Raiko et al. 2016. Ladder variational autoencoders. In Advances in neural information processing systems. 3738--3746.
- Jakub M Tomczak and Max Welling . 2018 . VAE with a vampprior . In 21st International Conference on Artificial Intelligence and Statistics, AISTATS. 1214--1223 . Jakub M Tomczak and Max Welling. 2018. VAE with a vampprior. In 21st International Conference on Artificial Intelligence and Statistics, AISTATS. 1214--1223.
Cited by
Deep Learning for Time Series Anomaly Detection: A Survey
Zamanzadeh Darban, Z., Webb, G. I., Pan, S., Aggarwal, C., & Salehi, M. (2025) · ACM Computing Surveys · doi:10.1145/3691338 · Cited by 613
Anomaly Transformer: Time Series Anomaly Detection with Association Discrepancy
Xu, J., Wu, H., Wang, J., & Long, M. (2021) · arXiv (Cornell University) · doi:10.4230/lipics.time.2024.17 · Cited by 233
DCdetector: Dual Attention Contrastive Representation Learning for Time Series Anomaly Detection
Yang, Y., Zhang, C., Zhou, T., Wen, Q., & Sun, L. (2023) · Proceedings of the 29th ACM SIGKDD Conference on Knowledge Discovery and Data Mining · doi:10.1145/3580305.3599295 · Cited by 387
MST-GAT: A multimodal spatial–temporal graph attention network for time series anomaly detection
Ding, C., Sun, S., & Zhao, J. (2023) · Information Fusion · doi:10.1016/j.inffus.2022.08.011 · Cited by 309
Self-Supervised Learning for Time Series Analysis: Taxonomy, Progress, and Prospects
Zhang, K., Wen, Q., Zhang, C., Cai, R., Jin, M., Liu, Y., Zhang, J. Y., Liang, Y., Pang, G., Song, D., et al. (2024) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2024.3387317 · Cited by 295
“InterFusion[77], OmniAnomaly[78], GRELEN[79],”
Background
Metadata
- Authors
- Li, Z., Zhao, Y., Han, J., Su, Y., Jiao, R., Wen, X., & Pei, D.
- Affiliations
- Tsinghua University (CN)
- Venue
- Proceedings of the 27th ACM SIGKDD Conference on Knowledge Discovery & Data Mining
- Publisher
- ACM
- Published
- 2021-08-14
- Pages
- 3220-3230
- OpenAlex
- W3170937175
- Cited by
- 464
- References
- 21
- Citations by year
- 2026: 90 · 2025: 143 · 2024: 104 · 2023: 96 · 2022: 29 · 2021: 2
- FWCI
- 26.68
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) (publishedVersion)
- Funders
- National Key R&D Program of China (Grant No.2019YFE0105500)
- State Key Program of National Natural Science of China (Grant 62072264)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Anomaly Detection Techniques and Applications
- Physical Sciences › Computer Science › Computer Networks and Communications › Software System Performance and Reliability
- Physical Sciences › Computer Science › Signal Processing › Time Series Analysis and Forecasting
- Keywords
- multivariate time series anomaly detection, anomaly interpretation, temporal dependencies, hierarchical variational autoencoder, temporal embeddings, unsupervised anomaly detection, industrial monitoring
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.