The DOI matches its Crossref record; 42 of the 42 references it cites were found in a registry or an index.
TadGAN: Time Series Anomaly Detection Using Generative Adversarial Networks
Open accessAbstract
Time series anomalies can offer information relevant to critical situations facing various fields, from finance and aerospace to the IT, security, and medical domains. However, detecting anomalies in time series data is particularly challenging due to the vague definition o f a nomalies and said data's frequent lack of labels and highly complex temporal correlations. Current state-of-the-art unsupervised machine learning methods for anomaly detection suffer from scalability and portability issues, and may have high false positive rates. In this paper, we propose TadGAN, an unsupervised anomaly detection approach built on Generative Adversarial Networks (GANs). To capture the temporal correlations of time series distributions, we use LSTM Recurrent Neural Networks as base models for Generators and Critics. TadGAN is trained with cycle consistency loss to allow for effective time-series data reconstruction. We further propose several novel methods to compute reconstruction errors, as well as different approaches to combine reconstruction errors and Critic outputs to compute anomaly scores. To demonstrate the performance and generalizability of our approach, we test several anomaly scoring techniques and report the best-suited one. We compare our approach to 8 baseline anomaly detection methods on 11 datasets from multiple reputable sources such as NASA, Yahoo, Numenta, Amazon, and Twitter. The results show that our approach can effectively detect anomalies and outperform baseline methods in most cases (6 out of 11). Notably, our method has the highest averaged F1 score across all the datasets. Our code is open source and is available as a benchmarking tool.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Unpaired image-to-image translation using cycle-consistent adversarial networks
Zhu, J.-Y., Park, T., Isola, P., & Efros, A. A. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.244 · Cited by 23,602
GAN(Generative Adversarial Nets)
(2017) · Journal of Japan Society for Fuzzy Theory and Intelligent Informatics · doi:10.3156/jsoft.29.5_177_2 · Cited by 19,270
Chandola, V., Banerjee, A., & Kumar, V. (2009) · ACM Computing Surveys · doi:10.1145/1541880.1541882 · Cited by 11,687 · cited 5×
“A time series anomaly is de-fined as a time point or period where a system behaves unusually [8].”
BackgroundInfluentialImproved training of Wasserstein GANs
Gulrajani, I., Ahmed, F., Arjovsky, M., Dumoulin, V., & Courville, A. (2017) · arXiv · doi:10.48550/arxiv.1704.00028 · Cited by 6,800 · cited 1×
“In addition, to enforce the 1-Lipschitz constraint during training, we apply a gradient penalty regularization term as introduced by Gul-rajani et al. [17], which penalizes gradients not equal to 1 (cf. line 5).”
Method(2017) · International Conference on Machine Learning · Cited by 6,382
Time Series Analysis: Forecasting and Control.
Anderson, O. D., Box, G. E. P., & Jenkins, G. M. (1978) · The Statistician · doi:10.2307/2988198 · Cited by 5,298
LOF: identifying density-based local outliers
Breunig, M. M., Kriegel, H.-P., Ng, R. T., & Sander, J. (2000) · ACM SIGMOD Record · doi:10.1145/335191.335388 · Cited by 5,207
LOF: identifying density-based local outliers
Breunig, M. M., Kriegel, H.-P., Ng, R. T., & Sander, J. (2000) · Proceedings of the 2000 ACM SIGMOD international conference on Management of data · doi:10.1145/342009.335388 · Cited by 4,149 · cited 1×
“st Neighbor (KNN) [3] – which use a given radius to define neighbors of an object and use the number of neighbors to determine an anomaly score – and densitybasedmethods,suchas LocalOutlier Factor(LOF)[7] and Clustering-Based Local Outlier Factor [19], which further consider the density of an object and that of its nei…”
MethodA Survey of Outlier Detection Methodologies
Hodge, V., & Austin, J. (2004) · Artificial Intelligence Review · doi:10.1007/s10462-004-4304-y · Cited by 3,596
Deep learning for time series classification: a review
Ismail Fawaz, H., Forestier, G., Weber, J., Idoumghar, L., & Muller, P.-A. (2019) · Data Mining and Knowledge Discovery · doi:10.1007/s10618-019-00619-1 · Cited by 3,342 · cited 1×
“A few aspects of this problem make it both distinct from and more difficult than time series classification [15] or supervised time series anomaly detection [16], as well as more pertinent to many industrial applications.”
Background(1994) · Knowledge Discovery and Data Mining · Cited by 3,137
DeepAR: Probabilistic forecasting with autoregressive recurrent networks
Salinas, D., Flunkert, V., Gasthaus, J., & Januschowski, T. (2020) · International Journal of Forecasting · doi:10.1016/j.ijforecast.2019.07.001 · Cited by 2,661
Unsupervised Anomaly Detection with Generative Adversarial Networks to Guide Marker Discovery
Schlegl, T., Seeböck, P., Waldstein, S. M., Schmidt-Erfurth, U., & Langs, G. (2017) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-59050-9_12 · Cited by 2,627
Time-series Generative Adversarial Networks
Yoon, J., Jarrett, D., & van der Schaar, M. (2019) · neural information processing systems · Cited by 2,070
Detecting Spacecraft Anomalies Using LSTMs and Nonparametric Dynamic Thresholding
Hundman, K., Constantinou, V., Laporte, C., Colwell, I., & Soderstrom, T. (2018) · Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining · doi:10.1145/3219819.3219845 · Cited by 1,771
Automatic Classification of Heartbeats Using ECG Morphology and Heartbeat Interval Features
deChazal, P., O'Dwyer, M., & Reilly, R. B. (2004) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2004.827359 · Cited by 1,671
Makhzani, A., Shlens, J., Jaitly, N., Goodfellow, I., & Frey, B. (2015) · arXiv · doi:10.48550/arxiv.1511.05644 · Cited by 1,579
f-AnoGAN: Fast unsupervised anomaly detection with generative adversarial networks
Schlegl, T., Seeböck, P., Waldstein, S. M., Langs, G., & Schmidt-Erfurth, U. (2019) · Medical Image Analysis · doi:10.1016/j.media.2019.01.010 · Cited by 1,545
(2015) · Cited by 1,279
Long Short Term Memory Networks for Anomaly Detection in Time Series.
Malhotra, P., Vig, L., Shroff, G. M., & Agarwal, P. (2015) · The European Symposium on Artificial Neural Networks · Cited by 1,259
MAD-GAN: Multivariate Anomaly Detection for Time Series Data with Generative Adversarial Networks
Li, D., Chen, D., Jin, B., Shi, L., Goh, J., & Ng, S.-K. (2019) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-30490-4_56 · Cited by 1,185
Discovering cluster-based local outliers
He, Z., Xu, X., & Deng, S. (2003) · Pattern Recognition Letters · doi:10.1016/s0167-8655(03)00003-5 · Cited by 1,055
A Comparative Evaluation of Unsupervised Anomaly Detection Algorithms for Multivariate Data
Goldstein, M., & Uchida, S. (2016) · PLOS ONE · doi:10.1371/journal.pone.0152173 · Cited by 1,032
Unsupervised real-time anomaly detection for streaming data
Ahmad, S., Lavin, A., Purdy, S., & Agha, Z. (2017) · Neurocomputing · doi:10.1016/j.neucom.2017.04.070 · Cited by 995
Fast Outlier Detection in High Dimensional Spaces
Angiulli, F., & Pizzuti, C. (2002) · Lecture Notes in Computer Science · doi:10.1007/3-540-45681-3_2 · Cited by 836
LSTM-based Encoder-Decoder for Multi-sensor Anomaly Detection
Malhotra, P., Ramakrishnan, A., Anand, G., Vig, L., Agarwal, P., & Shroff, G. (2016) · arXiv · doi:10.48550/arxiv.1607.00148 · Cited by 819 · cited 3×
“LSTM AutoEncoder, 2016 [27] 5 LSTM, 2018 [21] 5 MAD-GAN, 2019 [24] 0 MS Azure, 2019 [30] 0 DeepAR, 2019 [32] 6”
MethodA survey of deep learning-based network anomaly detection
Kwon, D., Kim, H., Kim, J., Suh, S. C., Kim, I., & Kim, K. J. (2019) · Cluster Computing · doi:10.1007/s10586-017-1117-8 · Cited by 778
From Model, Signal to Knowledge: A Data-Driven Perspective of Fault Detection and Diagnosis
Dai, X., & Gao, Z. (2013) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2013.2243743 · Cited by 728
Time-Series Anomaly Detection Service at Microsoft
Ren, H., Xu, B., Wang, Y., Yi, C., Huang, C., Kou, X., Xing, T., Yang, M., Tong, J., & Zhang, Q. (2019) · Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining · doi:10.1145/3292500.3330680 · Cited by 623
Adversarially Learned Inference
Dumoulin, V., Belghazi, M. I., Poole, B., Mastropietro, O., Lamb, A., Arjovsky, M., & Courville, A. C. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1606.00704 · Cited by 579
Real-time big data processing for anomaly detection: A survey
Ariyaluran Habeeb, R. A., Nasaruddin, F., Gani, A., Targio Hashem, I. A., Ahmed, E., & Imran, M. (2019) · International Journal of Information Management · doi:10.1016/j.ijinfomgt.2018.08.006 · Cited by 487
Evaluating Real-Time Anomaly Detection Algorithms -- The Numenta Anomaly Benchmark
Lavin, A., & Ahmad, S. (2015) · 2015 IEEE 14th International Conference on Machine Learning and Applications (ICMLA) · doi:10.1109/icmla.2015.141 · Cited by 457
Generating Videos with Scene Dynamics
Vondrick, C., Pirsiavash, H., & Torralba, A. (2016) · Maryland Shared Open Access Repository · doi:10.13016/m26gih-tnyz · Cited by 441
Anomaly Detection in Cyber Physical Systems Using Recurrent Neural Networks
Goh, J., Adepu, S., Tan, M., & Lee, Z. S. (2017) · 2017 IEEE 18th International Symposium on High Assurance Systems Engineering (HASE) · doi:10.1109/hase.2017.36 · Cited by 413
Adversarially Learned Anomaly Detection
Zenati, H., Romain, M., Foo, C.-S., Lecouat, B., & Chandrasekhar, V. (2018) · 2018 IEEE International Conference on Data Mining (ICDM) · doi:10.1109/icdm.2018.00088 · Cited by 397
Sensitivity of PCA for traffic anomaly detection
Ringberg, H., Soule, A., Rexford, J., & Diot, C. (2007) · Proceedings of the 2007 ACM SIGMETRICS international conference on Measurement and modeling of computer systems · doi:10.1145/1254882.1254895 · Cited by 353
BeatGAN: Anomalous Rhythm Detection using Adversarially Generated Time Series
Zhou, B., Liu, S., Hooi, B., Cheng, X., & Ye, J. (2019) · Proceedings of the Twenty-Eighth International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2019/616 · Cited by 333 · cited 2×
“ion-based, and reconstruction-based anomaly detection (Table II). Methodology Papers Proximity [23]–[25] Prediction [2], [6], [26], [27] Reconstruction [5], [28]–[30] Reconstruction (GANs) [7], [14], [31] TABLE II UNSUPERVISED APPROACHES TO TIME SERIES ANOMALY DETECTION. A. Anomaly Detection for Time Series Data. Prox…”
MethodImage Anomaly Detection with Generative Adversarial Networks
Deecke, L., Vandermeulen, R., Ruff, L., Mandt, S., & Kloft, M. (2019) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-10925-7_1 · Cited by 203
Anomaly Detection Using Forecasting Methods ARIMA and HWDS
Pena, E. H. M., de Assis, M. V. O., & Proença, M. L. (2013) · Proceedings/Proceedings - International Conference of the Chilean Computer Science Society · doi:10.1109/sccc.2013.18 · Cited by 72
KPI-TSAD: A Time-Series Anomaly Detector for KPI Monitoring in Cloud Applications
Qiu, J., Du, Q., & Qian, C. (2019) · Symmetry · doi:10.3390/sym11111350 · Cited by 42
Enhanced Telemetry Monitoring with Novelty Detection
Heras, J. A. M., & Donati, A. (2014) · AI Magazine · doi:10.1609/aimag.v35i4.2553 · Cited by 40
Self-adaptive statistical process control for anomaly detection in time series
Zheng, D., Li, F., & Zhao, T. (2016) · Expert Systems with Applications · doi:10.1016/j.eswa.2016.03.029 · Cited by 37
Cited by
Wang, F., Jiang, Y., Zhang, R., Wei, A., Xie, J., & Pang, X. (2025) · Sensors · doi:10.3390/s25010190 · Cited by 119
Navigating the metric maze: a taxonomy of evaluation metrics for anomaly detection in time series
Sørbø, S., & Ruocco, M. (2024) · Data Mining and Knowledge Discovery · doi:10.1007/s10618-023-00988-8 · Cited by 58
“This means we will not consider the numerous variants of precision and recall as their own metrics, only as part of the f 1 -score or the AUC PR score described in section 5.2.3.”
Influential(2024) · doi:10.1109/tii.2023.3288226 · Cited by 27
Metadata
- Authors
- Geiger, A., Liu, D., Alnegheimish, S., Cuesta-Infante, A., & Veeramachaneni, K.
- Venue
- 2020 IEEE International Conference on Big Data (Big Data)
- Publisher
- IEEE
- Published
- 2020-12-10
- Pages
- 33-43
- OpenAlex
- W3087090211
- Cited by
- 334
- References
- 42
- FWCI
- 14.51
- Type
- conference paper
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.