The DOI matches its Crossref record; 67 of the 67 references it cites were found in a registry or an index.
Unsupervised Deep Anomaly Detection for Multi-Sensor Time-Series Signals
Open accessAbstract
Nowadays, multi-sensor technologies are applied in many fields, e.g., Health Care (HC), Human Activity Recognition (HAR), and Industrial Control System (ICS). These sensors can generate a substantial amount of multivariate time-series data. Unsupervised anomaly detection on multi-sensor time-series data has been proven critical in machine learning researches. The key challenge is to discover generalized normal patterns by capturing spatial-temporal correlation in multi-sensor data. Beyond this challenge, the noisy data is often intertwined with the training data, which is likely to mislead the model by making it hard to distinguish between the normal, abnormal, and noisy data. Few of previous researches can jointly address these two challenges. In this paper, we propose a novel deep learning-based anomaly detection algorithm called Deep Convolutional Autoencoding Memory network (CAE-M). We first build a Deep Convolutional Autoencoder to characterize spatial dependence of multi-sensor data with a Maximum Mean Discrepancy (MMD) to better distinguish between the noisy, normal, and abnormal data. Then, we construct a Memory Network consisting of linear (Autoregressive Model) and non-linear predictions (Bidirectional LSTM with Attention) to capture temporal dependence from time-series data. Finally, CAE-M jointly optimizes these two subnetworks. We empirically compare the proposed approach with several state-of-the-art anomaly detection methods on HAR and HC datasets. Experimental results demonstrate that our proposed model outperforms these existing methods.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling
Chung, J., Gulcehre, C., Cho, K., & Bengio, Y. (2014) · arXiv · doi:10.48550/arxiv.1412.3555 · Cited by 11,008
Nonlinear Component Analysis as a Kernel Eigenvalue Problem
Schölkopf, B., Smola, A., & Müller, K.-R. (1998) · Neural Computation · doi:10.1162/089976698300017467 · Cited by 8,084
Extracting and composing robust features with denoising autoencoders
Vincent, P., Larochelle, H., Bengio, Y., & Manzagol, P.-A. (2008) · Proceedings of the 25th international conference on Machine learning - ICML '08 · doi:10.1145/1390156.1390294 · Cited by 7,436
Hamilton, J. D. (1994) · Princeton University Press eBooks · doi:10.1515/9780691218632 · Cited by 7,293
Greff, K., Srivastava, R. K., Koutnik, J., Steunebrink, B. R., & Schmidhuber, J. (2017) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2016.2582924 · Cited by 6,955 · cited 1×
“Non-linear predictor function has different types such as Recurrent neural networks (RNNs), Long Short-Term Memory (LSTM)[58] and Gated Recurrent Unit (GRU) [59].”
BackgroundEstimating the Support of a High-Dimensional Distribution
Schölkopf, B., Platt, J. C., Shawe-Taylor, J., Smola, A. J., & Williamson, R. C. (2001) · Neural Computation · doi:10.1162/089976601750264965 · Cited by 6,168 · cited 9×
“Conventional anomaly detection techniques such as PCA [17], k-means [18], OCSVM [19] and Autoencoder [20] are unable to deal with multivariate timeseries signals since they cannot simultaneously capture the spatial and temporal dependencies.”
BackgroundMethodInfluentialLong-term recurrent convolutional networks for visual recognition and description
Donahue, J., Hendricks, L. A., Guadarrama, S., Rohrbach, M., Venugopalan, S., Darrell, T., & Saenko, K. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298878 · Cited by 5,228
Support Vector Data Description
Tax, D. M. J., & Duin, R. P. W. (2004) · Machine Learning · doi:10.1023/b:mach.0000008084.60811.49 · Cited by 3,512
Deep Learning for Anomaly Detection: A Review
Pang, G., Shen, C., Cao, L., & Hengel, A. V. D. (2022) · ACM Computing Surveys · doi:10.1145/3439950 · Cited by 2,837
Modeling Long- and Short-Term Temporal Patterns with Deep Neural Networks
Lai, G., Chang, W.-C., Yang, Y., & Liu, H. (2018) · The 41st International ACM SIGIR Conference on Research & Development in Information Retrieval · doi:10.1145/3209978.3210006 · Cited by 2,152
Deep learning for sensor-based activity recognition: A survey
Wang, J., Chen, Y., Hao, S., Peng, X., & Hu, L. (2019) · Pattern Recognition Letters · doi:10.1016/j.patrec.2018.02.010 · Cited by 2,014
Self-citationConnecting the Dots: Multivariate Time Series Forecasting with Graph Neural Networks
Wu, Z., Pan, S., Long, G., Jiang, J., Chang, X., & Zhang, C. (2020) · Proceedings of the 26th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining · doi:10.1145/3394486.3403118 · Cited by 2,001
Gong, D., Liu, L., Le, V., Saha, B., Mansour, M. R., Venkatesh, S., & Van Den Hengel, A. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00179 · Cited by 1,930
Unsupervised Learning of Video Representations using LSTMs
Srivastava, N., Mansimov, E., & Salakhutdinov, R. (2015) · arXiv · doi:10.48550/arxiv.1502.04681 · Cited by 1,861
Inceptiontime: finding alexnet for time series classification
Ismail Fawaz, H., Lucas, B., Forestier, G., Pelletier, C., Schmidt, D. F., Weber, J., Webb, G. I., Idoumghar, L., Muller, P.-A., & Petitjean, F. (2020) · Data Mining and Knowledge Discovery · doi:10.1007/s10618-020-00710-y · Cited by 1,788 · cited 1×
“For example, some 1D-CNN models [51], [52] have been proposed to solve time series tasks with a very simple structure and the sota performance.”
MethodFuture Frame Prediction for Anomaly Detection - A New Baseline
Liu, W., Luo, W., Lian, D., & Gao, S. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00684 · Cited by 1,530
Introducing a New Benchmarked Dataset for Activity Monitoring
Reiss, A., & Stricker, D. (2012) · 2012 16th International Symposium on Wearable Computers · doi:10.1109/iswc.2012.13 · Cited by 1,456 · cited 2×
“PAMAP2 [61] Activity Recognition 1,140,000 27 18 Public CAP [62] Sleep Stage Detection 921,700,000 21 8 Public Mental Fatigue Dataset [2] Fatigue Detection 1,458,648 4 2 Private ZHANG ETAL.”
BackgroundMethodAnomaly Detection Using Autoencoders with Nonlinear Dimensionality Reduction
Sakurada, M., & Yairi, T. (2014) · Proceedings of the MLSDA 2014 2nd Workshop on Machine Learning for Sensory Data Analysis · doi:10.1145/2689746.2689747 · Cited by 1,438
Anomaly Detection with Robust Deep Autoencoders
Zhou, C., & Paffenroth, R. C. (2017) · Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/3097983.3098052 · Cited by 1,436
Learning Temporal Regularity in Video Sequences
Hasan, M., Choi, J., Neumann, J., Roy-Chowdhury, A. K., & Davis, L. S. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.86 · Cited by 1,397
Deep Learning for Anomaly Detection: A Survey
Chalapathy, R., & Chawla, S. (2019) · arXiv · doi:10.48550/arxiv.1901.03407 · Cited by 1,240
MAD-GAN: Multivariate Anomaly Detection for Time Series Data with Generative Adversarial Networks
Li, D., Chen, D., Jin, B., Shi, L., Goh, J., & Ng, S.-K. (2019) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-30490-4_56 · Cited by 1,185
Bidirectional LSTM with attention mechanism and convolutional layer for text classification
Liu, G., & Guo, J. (2019) · Neurocomputing · doi:10.1016/j.neucom.2019.01.078 · Cited by 1,127
FedHealth: A Federated Transfer Learning Framework for Wearable Healthcare
Chen, Y., Qin, X., Wang, J., Yu, C., & Gao, W. (2020) · IEEE Intelligent Systems · doi:10.1109/mis.2020.2988604 · Cited by 1,005
Self-citationA Unifying Review of Deep and Shallow Anomaly Detection
Ruff, L., Kauffmann, J. R., Vandermeulen, R. A., Montavon, G., Samek, W., Kloft, M., Dietterich, T. G., & Muller, K.-R. (2021) · Proceedings of the IEEE · doi:10.1109/jproc.2021.3052449 · Cited by 914
Zhang, C., Song, D., Chen, Y., Feng, X., Lumezanu, C., Cheng, W., Ni, J., Zong, B., Chen, H., & Chawla, N. V. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33011409 · Cited by 855
Self-citationAngle-based outlier detection in high-dimensional data
Kriegel, H.-P., Schubert, M., & Zimek, A. (2008) · Proceedings of the 14th ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/1401890.1401946 · Cited by 828
LSTM-based Encoder-Decoder for Multi-sensor Anomaly Detection
Malhotra, P., Ramakrishnan, A., Anand, G., Vig, L., Agarwal, P., & Shroff, G. (2016) · arXiv · doi:10.48550/arxiv.1607.00148 · Cited by 819
Hyperopt: A Python Library for Optimizing the Hyperparameters of Machine Learning Algorithms
Bergstra, J., Yamins, D., & Cox, D. (2013) · Proceedings of the Python in Science Conference · doi:10.25080/majora-8b375195-003 · Cited by 781
Kernel PCA for novelty detection
Hoffmann, H. (2007) · Pattern Recognition · doi:10.1016/j.patcog.2006.07.009 · Cited by 762
Ball, J. E., Anderson, D. T., & Chan, C. S. (2017) · Journal of Applied Remote Sensing · doi:10.1117/1.jrs.11.042609 · Cited by 746
A Hilbert Space Embedding for Distributions
Smola, A., Gretton, A., Song, L., & Schölkopf, B. (2007) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-75225-7_5 · Cited by 706
Subha, D. P., Joseph, P. K., Acharya U, R., & Lim, C. M. (2010) · Journal of Medical Systems · doi:10.1007/s10916-008-9231-z · Cited by 627
Remembering history with convolutional LSTM for anomaly detection
Luo, W., Liu, W., & Gao, S. (2017) · 2017 IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme.2017.8019325 · Cited by 582
Spatio-Temporal AutoEncoder for Video Anomaly Detection
Zhao, Y., Deng, B., Shen, C., Liu, Y., Lu, H., & Hua, X.-S. (2017) · Proceedings of the 25th ACM international conference on Multimedia · doi:10.1145/3123266.3123451 · Cited by 559
Ketkar, N. (2017) · Deep Learning with Python · doi:10.1007/978-1-4842-2766-4_7 · Cited by 529
Time-series novelty detection using one-class support vector machines
Ma, J., & Perkins, S. (2004) · Proceedings of the International Joint Conference on Neural Networks, 2003. · doi:10.1109/ijcnn.2003.1223670 · Cited by 392
Unsupervised Anomaly Detection With LSTM Neural Networks
Ergen, T., & Kozat, S. S. (2020) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2019.2935975 · Cited by 386
Rey, D., & Neuhäuser, M. (2011) · International Encyclopedia of Statistical Science · doi:10.1007/978-3-642-04898-2_616 · Cited by 386
Detecting Cyber Attacks in Industrial Control Systems Using Convolutional Neural Networks
Kravchik, M., & Shabtai, A. (2018) · Proceedings of the 2018 Workshop on Cyber-Physical Systems Security and PrivaCy · doi:10.1145/3264888.3264896 · Cited by 355
A Novel Feature Extraction for Robust EMG Pattern Recognition
Phinyomark, A., Limsakul, C., & Phukpattaranont, P. (2009) · arXiv (Cornell University) · doi:10.48550/arxiv.0912.3973 · Cited by 351
Terzano, M. G., Parrino, L., Smerieri, A., Chervin, R., Chokroverty, S., Guilleminault, C., Hirshkowitz, M., Mahowald, M., Moldofsky, H., Rosa, A., et al. (2002) · Sleep Medicine · doi:10.1016/s1389-9457(02)00003-5 · Cited by 292
Outlier Detection with Kernel Density Functions
Latecki, L. J., Lazarevic, A., & Pokrajac, D. (2007) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-73499-4_6 · Cited by 273
Stratified Transfer Learning for Cross-domain Activity Recognition
Wang, J., Chen, Y., Hu, L., Peng, X., & Yu, P. S. (2018) · 2018 IEEE International Conference on Pervasive Computing and Communications (PerCom) · doi:10.1109/percom.2018.8444572 · Cited by 253
Self-citationSpatio-temporal video autoencoder with differentiable memory
Pătrăucean, V., Handa, A., & Cipolla, R. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1511.06309 · Cited by 211
Anomaly Detection with Generative Adversarial Networks for Multivariate Time Series
Li, D., Chen, D., Goh, J., & Ng, S.-K. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1809.04758 · Cited by 211
Anomaly Detection in Video Using Predictive Convolutional Long Short-Term Memory Networks
Medel, J. R., & Savakis, A. E. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1612.00390 · Cited by 194
Arima model for network traffic prediction and anomaly detection
Moayedi, H., & Masnadi-Shirazi, M. A. (2008) · International Symposium on Information Technology · doi:10.1109/itsim.2008.4631947 · Cited by 187
Deep Transfer Learning for Cross-domain Activity Recognition
Wang, J., Zheng, V. W., Chen, Y., & Huang, M. (2018) · International Conference on Crowd Science and Engineering (ICCSE) · doi:10.1145/3265689.3265705 · Cited by 183
Self-citationUnsupervised Sequential Outlier Detection With Deep Architectures
Lu, W., Cheng, Y., Xiao, C., Chang, S., Huang, S., Liang, B., & Huang, T. S. (2017) · IEEE Transactions on Image Processing · doi:10.1109/tip.2017.2713048 · Cited by 127
Salient Subsequence Learning for Time Series Clustering
Zhang, Q., Wu, J. X., Zhang, P., Long, G., & Chengqi Zhang, B. (2018) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2018.2847699 · Cited by 113
Shalyga, D., Filonov, P., & Lavrentyev, A. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1807.07282 · Cited by 103
Semi-Supervised Anomaly Detection for EEG Waveforms Using Deep Belief Nets
Wulsin, D., Blanco, J., Mani, R., & Litt, B. (2010) · 2010 Ninth International Conference on Machine Learning and Applications · doi:10.1109/icmla.2010.71 · Cited by 98 · cited 1×
“Others like Denoising AutoEncoders (DAEs) [22], Deep Belief Networks (DBNs) [39] and Robust Deep Autoencoder (RDA) [40] have also been reported good performance for anomaly detection.”
BackgroundInvestigating hidden Markov models capabilities in anomaly detection
Joshi, S. S., & Phoha, V. V. (2005) · doi:10.1145/1167350.1167387 · Cited by 96
Cross-position activity recognition with stratified transfer learning
Chen, Y., Wang, J., Huang, M., & Yu, H. (2019) · Pervasive and Mobile Computing · doi:10.1016/j.pmcj.2019.04.004 · Cited by 96
Self-citationRethinking 1D-CNN for Time Series Classification: A Stronger Baseline.Preprint
Tang, W., Long, G., Liu, L., Zhou, T., Jiang, J. B., & Blumenstein, M. (2020) · arXiv (Cornell University) · Cited by 90
Deep unsupervised multi-modal fusion network for detecting driver distraction
Zhang, Y., Chen, Y., & Gao, C. (2020) · Neurocomputing · doi:10.1016/j.neucom.2020.09.023 · Cited by 78
Self-citationRobust kernel density estimation
Kim, J., & Scott, C. D. (2008) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2008.4518376 · Cited by 77
RNN-based Early Cyber-Attack Detection for the Tennessee Eastman ProcessPreprint
Filonov, P., Kitashov, F., & Lavrentyev, A. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1709.02232 · Cited by 70
Robust multivariate autoregression for anomaly detection in dynamic product ratings
Günnemann, N., Günnemann, S., & Faloutsos, C. (2014) · International World Wide Web Conference (WWW) · doi:10.1145/2566486.2568008 · Cited by 61
Application of the control variate technique to estimation of total sensitivity indices
Kucherenko, S. S., Delpuech, B., Iooss, B., & Tarantola, S. (2014) · Reliability Engineering & System Safety · doi:10.1016/j.ress.2014.07.008 · Cited by 45
Space-Time Signal Processing for Distributed Pattern Detection in Sensor Networks
Paffenroth, R. C., Toit, P. D., Nong, R., Scharf, L. L., Jayasumana, A. P., & Bandara, V. W. (2013) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2012.2237381 · Cited by 44
Unsupervised Anomaly Detection for High Dimensional Data—an Exploratory Analysis
Ramchandran, A., & Sangaiah, A. K. (2018) · Elsevier eBooks · doi:10.1016/b978-0-12-813314-9.00011-6 · Cited by 42
Multi-modality Sensor Data Classification with Selective Attention
Zhang, X., Yao, L., Huang, C., Wang, S., Tan, M., Long, G., & Wang, C. (2018) · Proceedings of the Twenty-Seventh International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2018/432 · Cited by 41
Dynamic Illness Severity Prediction via Multi-task RNNs for Intensive Care Unit
Chen, W., Wang, S., Long, G., Yao, L., Sheng, Q. Z., & Li, X. (2018) · Proceedings · doi:10.1109/icdm.2018.00111 · Cited by 32
Robust PCA for Anomaly Detection in Cyber NetworksPreprint
Paffenroth, R. C., Kay, K., & Servi, L. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1801.01571 · Cited by 31
A Deep Temporal Model for Mental Fatigue Detection
Zhang, Y., Chen, Y., & Pan, Z. (2018) · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/smc.2018.00325 · Cited by 21
Self-citation
Cited by
TranAD: deep transformer networks for anomaly detection in multivariate time series data
Tuli, S., Casale, G., & Jennings, N. R. (2022) · Proceedings of the VLDB Endowment · doi:10.14778/3514061.3514067 · Cited by 1,063
Deep Learning for Time Series Anomaly Detection: A Survey
Zamanzadeh Darban, Z., Webb, G. I., Pan, S., Aggarwal, C., & Salehi, M. (2025) · ACM Computing Surveys · doi:10.1145/3691338 · Cited by 613
UMMAFormer: A Universal Multimodal-adaptive Transformer Framework for Temporal Forgery Localization
Zhang, R., Wang, H., Du, M., Liu, H., Zhou, Y., & Zeng, Q. (2023) · Proceedings of the 31st ACM International Conference on Multimedia · doi:10.1145/3581783.3613767 · Cited by 42
ICS anomaly detection based on sensor patterns and actuator rules in spatiotemporal dependency
Cai, J., Wei, Z., & Luo, J. (2024) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2024.3393528 · Cited by 38
Metadata
- Authors
- Zhang, Y., Chen, Y., Wang, J., & Pan, Z.
- Venue
- IEEE Transactions on Knowledge and Data Engineering
- Published
- 2021
- Pages
- 1-1
- ISSN
- 1041-4347 (ISSN-L)
- 1558-2191
- 2326-3865
- OpenAlex
- W3190748826
- Cited by
- 312
- References
- 67
- FWCI
- 15.44
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.