The DOI matches its Crossref record; 48 of the 48 references it cites were found in a registry or an index.
MST-GAT: A multimodal spatial–temporal graph attention network for time series anomaly detection
Open accessAbstract
Multimodal time series (MTS) anomaly detection is crucial for maintaining the safety and stability of working devices (e.g., water treatment system and spacecraft), whose data are characterized by multivariate time series with diverse modalities. Although recent deep learning methods show great potential in anomaly detection, they do not explicitly capture spatial-temporal relationships between univariate time series of different modalities, resulting in more false negatives and false positives. In this paper, we propose a multimodal spatial-temporal graph attention network (MST-GAT) to tackle this problem. MST-GAT first employs a multimodal graph attention network (M-GAT) and a temporal convolution network to capture the spatial-temporal correlation in multimodal time series. Specifically, M-GAT uses a multi-head attention module and two relational attention modules (i.e., intra- and inter-modal attention) to model modal correlations explicitly. Furthermore, MST-GAT optimizes the reconstruction and prediction modules simultaneously. Experimental results on four multimodal benchmarks demonstrate that MST-GAT outperforms the state-of-the-art baselines. Further analysis indicates that MST-GAT strengthens the interpretability of detected anomalies by locating the most anomalous univariate time series.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Auto-Encoding Variational Bayes
Kingma, D. P., & Welling, M. (2013) · arXiv · doi:10.48550/arxiv.1312.6114 · Cited by 20,067
Neural Machine Translation by Jointly Learning to Align and Translate
Bahdanau, D., Cho, K., & Bengio, Y. (2014) · arXiv · doi:10.48550/arxiv.1409.0473 · Cited by 16,213
Advances in neural information processing systems 7
(1996) · Computers & Mathematics with Applications · doi:10.1016/s0898-1221(96)90463-0 · Cited by 14,281
Advances in Neural Information Processing Systems 29
Teymur, O., Zygalakis, K., & Calderhead, B. (2016) · Cited by 13,887
Veličković, P., Cucurull, G., Casanova, A., Romero, A., Liò, P., & Bengio, Y. (2017) · arXiv · doi:10.48550/arxiv.1710.10903 · Cited by 12,107
Chandola, V., Banerjee, A., & Kumar, V. (2009) · ACM Computing Surveys · doi:10.1145/1541880.1541882 · Cited by 11,687 · cited 1×
“Anomaly detection has gained much attention in different fields (e.g., images [1], text [2], time series [3], etc.), aiming to find instances that deviate significantly from all other observations [4, 5].”
Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling
Chung, J., Gulcehre, C., Cho, K., & Bengio, Y. (2014) · arXiv · doi:10.48550/arxiv.1412.3555 · Cited by 11,008
A Comprehensive Survey on Graph Neural Networks
Wu, Z., Pan, S., Chen, F., Long, G., Zhang, C., & Yu, P. S. (2021) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2020.2978386 · Cited by 11,000
Veličković, P., Casanova, A., Liò, P., Cucurull, G., Romero, A., & Bengio, Y. (2017) · arXiv (Cornell University) · doi:10.17863/cam.48429 · Cited by 8,657
Time series forecasting using a hybrid ARIMA and neural network model
Zhang, G. P. (2003) · Neurocomputing · doi:10.1016/s0925-2312(01)00702-0 · Cited by 4,428
International Conference on Artificial Neural Networks
(1990) · Neural Networks · doi:10.1016/0893-6080(90)90065-s · Cited by 2,088
Geometric Deep Learning on Graphs and Manifolds Using Mixture Model CNNs
Monti, F., Boscaini, D., Masci, J., Rodola, E., Svoboda, J., & Bronstein, M. M. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.576 · Cited by 1,820
Robust Anomaly Detection for Multivariate Time Series through Stochastic Recurrent Neural Network
Su, Y., Zhao, Y., Niu, C., Liu, R., Sun, W., & Pei, D. (2019) · Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining · doi:10.1145/3292500.3330672 · Cited by 1,804 · cited 4×
“Inspired by OmniAnomaly [16], we use variational autoencoder (VAE) to reconstruct G t .”
BackgroundMethodInfluentialDetecting Spacecraft Anomalies Using LSTMs and Nonparametric Dynamic Thresholding
Hundman, K., Constantinou, V., Laporte, C., Colwell, I., & Soderstrom, T. (2018) · Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining · doi:10.1145/3219819.3219845 · Cited by 1,771 · cited 2×
“Hundman et al. [28] demonstrated the feasibility of long short-term memory (LSTM) in detecting spacecraft anomalies and introduced an approach for setting thresholds dynamically without relying on annotations.”
BackgroundA review of affective computing: From unimodal analysis to multimodal fusion
Poria, S., Cambria, E., Bajpai, R., & Hussain, A. (2017) · Information Fusion · doi:10.1016/j.inffus.2017.02.003 · Cited by 1,644
Graph Neural Network-Based Anomaly Detection in Multivariate Time Series
Deng, A., & Hooi, B. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i5.16523 · Cited by 1,413 · cited 7×
“MST-GAT outperforms GDN that also adopts graph attention networks, showing the feasibility of using the multimodal graph attention network and temporal convolutional network.”
MethodInfluentialDeep Learning for Anomaly Detection: A Survey
Chalapathy, R., & Chawla, S. (2019) · arXiv · doi:10.48550/arxiv.1901.03407 · Cited by 1,240 · cited 1×
“Anomaly detection has gained much attention in different fields (e.g., images [1], text [2], time series [3], etc.), aiming to find instances that deviate significantly from all other observations [4, 5].”
A Multimodal Anomaly Detector for Robot-Assisted Feeding Using an LSTM-Based Variational Autoencoder
Park, D., Hoshi, Y., & Kemp, C. C. (2018) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2018.2801475 · Cited by 1,115
USAD: UnSupervised Anomaly Detection on Multivariate Time Series
Audibert, J., Michiardi, P., Guyard, F., Marti, S., & Zuluaga, M. A. (2020) · Proceedings of the 26th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining · doi:10.1145/3394486.3403392 · Cited by 1,094
Zhang, C., Song, D., Chen, Y., Feng, X., Lumezanu, C., Cheng, W., Ni, J., Zong, B., Chen, H., & Chawla, N. V. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33011409 · Cited by 855
A Dataset to Support Research in the Design of Secure Water Treatment Systems
Goh, J., Adepu, S., Junejo, K. N., & Mathur, A. (2017) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-71368-7_8 · Cited by 729 · cited 1×
“Secure Water Treatment (SWaT) [50] dataset is collected from the scaleddown water treatment testbed with 51 sensors, consisting of seven days of normal operation and four days of simulated attack scenarios.”
MethodTime-Series Anomaly Detection Service at Microsoft
Ren, H., Xu, B., Wang, Y., Yi, C., Huang, C., Kou, X., Xing, T., Yang, M., Tong, J., & Zhang, Q. (2019) · Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining · doi:10.1145/3292500.3330680 · Cited by 623
Anomaly Detection in Streams with Extreme Value Theory
Siffer, A., Fouque, P.-A., Termier, A., & Largouet, C. (2017) · Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/3097983.3098144 · Cited by 553
WADI: a water distribution testbed for research in the design of secure cyber physical systems
Ahmed, C. M., Palleti, V. R., & Mathur, A. P. (2017) · Proceedings of the 3rd International Workshop on Cyber-Physical Systems for Smart Water Networks · doi:10.1145/3055366.3055375 · Cited by 550
2015 IEEE International Conference on Data Mining
(2015) · doi:10.1109/icdm36327.2015 · Cited by 521
Li, Z., Zhao, Y., Han, J., Su, Y., Jiao, R., Wen, X., & Pei, D. (2021) · Proceedings of the 27th ACM SIGKDD Conference on Knowledge Discovery & Data Mining · doi:10.1145/3447548.3467075 · Cited by 464
Anomaly Detection in Univariate Time-series: A Survey on the State-of-the-ArtPreprint
Braei, M., & Wagner, S. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2004.00433 · Cited by 401
Time-series novelty detection using one-class support vector machines
Ma, J., & Perkins, S. (2004) · Proceedings of the International Joint Conference on Neural Networks, 2003. · doi:10.1109/ijcnn.2003.1223670 · Cited by 392
Smart Anomaly Detection in Sensor Systems: A Multi-Perspective Review
Erhan, L., Ndubuaku, M., Di Mauro, M., Song, W., Chen, M., Fortino, G., Bagdasar, O., & Liotta, A. (2021) · Information Fusion · doi:10.1016/j.inffus.2020.10.001 · Cited by 378
Wang, S.-H., Govindaraj, V. V., Górriz, J. M., Zhang, X., & Zhang, Y.-D. (2021) · Information Fusion · doi:10.1016/j.inffus.2020.10.004 · Cited by 353
1993 IEEE International Conference on Robotics and Automation
(1993) · Journal of the Robotics Society of Japan · doi:10.7210/jrsj.11.673 · Cited by 332
On the Time Series $K$-Nearest Neighbor Classification of Abnormal Brain Activity
Chaovalitwongse, W. A., Fan, Y.-J., & Sachdeo, R. C. (2007) · IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans · doi:10.1109/tsmca.2007.897589 · Cited by 222
A probabilistic model for multimodal hash function learning
Zhen, Y., & Yeung, D.-Y. (2012) · Proceedings of the 18th ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/2339530.2339678 · Cited by 197
2009 IEEE International Conference on Cloud Computing
(2009) · doi:10.1109/cloud16188.2009 · Cited by 186
Puggini, L., & McLoone, S. (2017) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2017.09.021 · Cited by 124
Road Anomaly Detection by Partial Image Reconstruction with Segmentation Coupling
Vojir, T., Sipka, T., Aljundi, R., Chumerin, N., Reino, D. O., & Matas, J. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01536 · Cited by 116
Support vector regression for anomaly detection from measurement histories
Kromanis, R., & Kripakaran, P. (2013) · Advanced Engineering Informatics · doi:10.1016/j.aei.2013.03.002 · Cited by 109
Self-Attentive, Multi-Context One-Class Classification for Unsupervised Anomaly Detection on Text
Ruff, L., Zemlyanskiy, Y., Vandermeulen, R. A., Schnake, T., & Kloft, M. (2019) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p19-1398 · Cited by 100
Spatial-Temporal Convolutional Graph Attention Networks for Citywide Traffic Flow Forecasting
Zhang, X., Huang, C., Xu, Y., & Xia, L. (2020) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3340531.3411941 · Cited by 90
Time Series Anomaly Detection with Multiresolution Ensemble Decoding
Shen, L., Yu, Z., Ma, Q., & Kwok, J. T.-Y. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i11.17152 · Cited by 80
Time series classification using local distance-based features in multi-modal fusion networks
Iwana, B. K., & Uchida, S. (2019) · Pattern Recognition · doi:10.1016/j.patcog.2019.107024 · Cited by 58
Multi-modal multiple kernel learning for accurate identification of Tourette syndrome children
Wen, H., Liu, Y., Rekik, I., Wang, S., Chen, Z., Zhang, J., Zhang, Y., Peng, Y., & He, H. (2016) · Pattern Recognition · doi:10.1016/j.patcog.2016.09.039 · Cited by 57
Dyadic relational graph convolutional networks for skeleton-based human interaction recognition
Zhu, L., Wan, B., Li, C., Tian, G., Hou, Y., & Yuan, K. (2021) · Pattern Recognition · doi:10.1016/j.patcog.2021.107920 · Cited by 57
Visual Agreement Regularized Training for Multi-Modal Machine Translation
Yang, P., Chen, B., Zhang, P., et al. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i05.6484 · Cited by 38
Variational multimodal machine translation with underlying semantic alignment
Liu, X., Zhao, J., Sun, S., Liu, H., & Yang, H. (2020) · Information Fusion · doi:10.1016/j.inffus.2020.11.011 · Cited by 22
Self-citationGraph Attention Recurrent Neural Networks for Correlated Time Series Forecasting -- Full versionPreprint
Cirstea, R.-G., Guo, C., & Yang, B. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2103.10760 · Cited by 5
Chen, T., Wang, Z., Li, L., Li, D., Li, Z., Chang, X., Bian, P., Liang, G., Wang, Q., & Xie, T. (2025) · Schloss Dagstuhl – Leibniz-Zentrum für Informatik · doi:10.4230/lipics.ecoop.2025.6
Cited by
Zhao, F., Zhang, C., & Geng, B. (2024) · ACM Computing Surveys · doi:10.1145/3649447 · Cited by 480
Graph Attention Networks: A Comprehensive Review of Methods and Applications
Vrahatis, A. G., Lazaros, K., & Kotsiantis, S. (2024) · Future Internet · doi:10.3390/fi16090318 · Cited by 274
EHR-KnowGen: Knowledge-enhanced multimodal learning for disease diagnosis generation
Niu, S., Ma, J., Bai, L., Wang, Z., Guo, L., & Yang, X. (2024) · Information Fusion · doi:10.1016/j.inffus.2023.102069 · Cited by 59
ICS anomaly detection based on sensor patterns and actuator rules in spatiotemporal dependency
Cai, J., Wei, Z., & Luo, J. (2024) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2024.3393528 · Cited by 38
TE-G-SAGE: Explainable Edge-Aware Graph Neural Networks for Network Intrusion Detection
Luša, R., Pintar, D., & Vranić, M. (2025) · Modelling · doi:10.3390/modelling6040165 · Cited by 15
Metadata
- Authors
- Ding, C., Sun, S., & Zhao, J.
- Venue
- Information Fusion
- Publisher
- Elsevier BV
- Published
- 2023-01
- Volume
- 89
- Pages
- 527-536
- ISSN
- 1566-2535 (ISSN-L)
- OpenAlex
- W4291034555
- Cited by
- 309
- References
- 48
- FWCI
- 18.10
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.