Time Series Anomaly Detection for Cyber-physical Systems via Neural System Identification and Bayesian Filtering
Open accessThe DOI matches its Crossref record; 14 of the 14 references it cites were found in a registry or an index.
Abstract
Recent advances in AIoT technologies have led to an increasing popularity of utilizing machine learning algorithms to detect operational failures for cyber-physical systems (CPS). In its basic form, an anomaly detection module monitors the sensor measurements and actuator states from the physical plant, and detects anomalies in these measurements to identify abnormal operation status. Nevertheless, building effective anomaly detection models for CPS is rather challenging as the model has to accurately detect anomalies in presence of highly complicated system dynamics and unknown amount of sensor noise. In this work, we propose a novel time series anomaly detection method called Neural System Identification and Bayesian Filtering (NSIBF) in which a specially crafted neural network architecture is posed for system identification, i.e., capturing the dynamics of CPS in a dynamical state-space model; then a Bayesian filtering algorithm is naturally applied on top of the "identified" state-space model for robust anomaly detection by tracking the uncertainty of the hidden state of the system recursively over time. We provide qualitative as well as quantitative experiments with the proposed method on a synthetic and three real-world CPS datasets, showing that NSIBF compares favorably to the state-of-the-art methods with considerable improvements on anomaly detection in CPS.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
Chandola, V., Banerjee, A., & Kumar, V. (2009) · ACM Computing Surveys · doi:10.1145/1541880.1541882 · Cited by 11,687 · cited 1×
“Detecting anomalous behavior on a set of correlated time series signals has been an active research area in the machine learning community for a long time [9, 10].”
BackgroundLiu, F. T., Ting, K. M., & Zhou, Z.-H. (2008) · 2008 Eighth IEEE International Conference on Data Mining · doi:10.1109/icdm.2008.17 · Cited by 6,601 · cited 2×
“• Isolation Forest: Isolation Forest [40] is a popular anomaly detection algorithm that works on the principle of isolating anomalies using tree-based structures.”
MethodRobust Anomaly Detection for Multivariate Time Series through Stochastic Recurrent Neural Network
Su, Y., Zhao, Y., Niu, C., Liu, R., Sun, W., & Pei, D. (2019) · Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining · doi:10.1145/3292500.3330672 · Cited by 1,804 · cited 5×
“As a result, following the evaluation methods in [53], for the performance of a specific method on a dataset, we enumerate all”
BackgroundMethodInfluentialDetecting Spacecraft Anomalies Using LSTMs and Nonparametric Dynamic Thresholding
Hundman, K., Constantinou, V., Laporte, C., Colwell, I., & Soderstrom, T. (2018) · Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining · doi:10.1145/3219819.3219845 · Cited by 1,771
Deep Learning for Anomaly Detection: A Survey
Chalapathy, R., & Chawla, S. (2019) · arXiv · doi:10.48550/arxiv.1901.03407 · Cited by 1,240 · cited 1×
“Detecting anomalous behavior on a set of correlated time series signals has been an active research area in the machine learning community for a long time [9, 10].”
BackgroundCyber-Physical Systems Security—A Survey
Humayed, A., Lin, J., Li, F., & Luo, B. (2017) · IEEE Internet of Things Journal · doi:10.1109/jiot.2017.2703172 · Cited by 1,185 · cited 1×
“Furthermore, for security, privacy and other technical issues, it is often impossible for anomaly detection modules to access the control logic of the system [23].”
BackgroundUSAD: UnSupervised Anomaly Detection on Multivariate Time Series
Audibert, J., Michiardi, P., Guyard, F., Marti, S., & Zuluaga, M. A. (2020) · Proceedings of the 26th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining · doi:10.1145/3394486.3403392 · Cited by 1,094 · cited 3×
“USAD comes from a PyTorch implementation in the Github repository5.”
BackgroundMethodA Dataset to Support Research in the Design of Secure Water Treatment Systems
Goh, J., Adepu, S., Junejo, K. N., & Mathur, A. (2017) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-71368-7_8 · Cited by 1,045 · cited 1×
“scaled down water treatment plant producing filtered water [20].”
BackgroundLSTM-based Encoder-Decoder for Multi-sensor Anomaly Detection
Malhotra, P., Ramakrishnan, A., Anand, G., Vig, L., Agarwal, P., & Shroff, G. (2016) · arXiv · doi:10.48550/arxiv.1607.00148 · Cited by 819 · cited 3×
“• EncDec-AD: EncDec-AD [43] is a residual error-based time series anomaly detection algorithm using an LSTM-based encoder-decoder as a reconstruction model.”
BackgroundMethodA survey of physics-based attack detection in cyber-physical systems
Giraldo, J., Urbina, D., Cardenas, A., Valente, J., Faisal, M., Ruths, J., Tippenhauer, N. O., Sandberg, H., & Candell, R. (2019) · ACM Computing Surveys · doi:10.1145/3203245 · Cited by 535 · cited 1×
“An alert is then raised when the residual error between observed measurements and the predicted mean above a threshold or the likelihood of observed measurements below a threshold [19].”
BackgroundDeep Variational Bayes Filters: Unsupervised Learning of State Space Models from Raw Data
Karl, M., Soelch, M., Bayer, J., & van der Smagt, P. (2016) · arXiv · doi:10.48550/arxiv.1605.06432 · Cited by 232 · cited 1×
“Applications of recurrent variational autoencoder architectures have been investigated for constructing non-linear state space models [28, 32, 33] and learning disentangled representations [18].”
BackgroundA Disentangled Recognition and Nonlinear Dynamics Model for Unsupervised Learning
Fraccaro, M., Kamronn, S., Paquet, U., & Winther, O. (2017) · arXiv · doi:10.48550/arxiv.1710.05741 · Cited by 229 · cited 1×
“Applications of recurrent variational autoencoder architectures have been investigated for constructing non-linear state space models [28, 32, 33] and learning disentangled representations [18].”
BackgroundKrishnan, R. G., Shalit, U., & Sontag, D. (2015) · arXiv · doi:10.48550/arxiv.1511.05121 · Cited by 206
Cited by
Deep Learning for Time Series Anomaly Detection: A Survey
Zamanzadeh Darban, Z., Webb, G. I., Pan, S., Aggarwal, C., & Salehi, M. (2025) · ACM Computing Surveys · doi:10.1145/3691338 · Cited by 613
Navigating the metric maze: a taxonomy of evaluation metrics for anomaly detection in time series
Sørbø, S., & Ruocco, M. (2024) · Data Mining and Knowledge Discovery · doi:10.1007/s10618-023-00988-8 · Cited by 58
“…Detection (TSAD) has become increasingly popular in recent years due to its widespread application in various fields such as cyber-physical systems (Feng et al. 2021), rail transit (Wang et al. 2022), online service systems (Ma et al. 2021), smart grids (Zhang et al. 2021), spacecraft telemetry…”
ADT: Time series anomaly detection for cyber-physical systems via deep reinforcement learning
Yang, X., Howley, E., & Schukat, M. (2024) · Computers & Security · doi:10.1016/j.cose.2024.103825 · Cited by 47
Causality-guided counterfactual debiasing for anomaly detection of cyber-physical systems
Tang, W., Liu, J., Zhou, Y., & Ding, Z. (2024) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2023.3326544 · Cited by 16
Anomaly Detection based on Robust Spatial-temporal Modeling for Industrial Control Systems
Li, S., Liu, J., Pan, Z., Lv, S., Si, S., & Sun, L. (2022) · 2022 IEEE 19th International Conference on Mobile Ad Hoc and Smart Systems (MASS) · doi:10.1109/mass56207.2022.00058 · Cited by 6
Metadata
- Authors
- Feng, C., & Tian, P.
- Venue
- Proceedings of the 27th ACM SIGKDD Conference on Knowledge Discovery & Data Mining
- Publisher
- ACM
- Published
- 2021-08-14
- Pages
- 2858-2867
- OpenAlex
- W3166888304
- Cited by
- 102
- References
- 14
- FWCI
- 7.53
- Type
- conference paper
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.