The DOI matches its Crossref record; 117 of the 117 references it cites were found in a registry or an index.
Anomaly detection in time series: a comprehensive evaluation
Open accessAbstract
Detecting anomalous subsequences in time series data is an important task in areas ranging from manufacturing processes over finance applications to health care monitoring. An anomaly can indicate important events, such as production faults, delivery bottlenecks, system defects, or heart flicker, and is therefore of central interest. Because time series are often large and exhibit complex patterns, data scientists have developed various specialized algorithms for the automatic detection of such anomalous patterns. The number and variety of anomaly detection algorithms has grown significantly in the past and, because many of these solutions have been developed independently and by different research communities, there is no comprehensive study that systematically evaluates and compares the different approaches. For this reason, choosing the best detection technique for a given anomaly detection task is a difficult challenge. This comprehensive, scientific study carefully evaluates most state-of-the-art anomaly detection algorithms. We collected and re-implemented 71 anomaly detection algorithms from different domains and evaluated them on 976 time series datasets. The algorithms have been selected from different algorithm families and detection approaches to represent the entire spectrum of anomaly detection techniques. In the paper, we provide a concise overview of the techniques and their commonalities; we evaluate their individual strengths and weaknesses and, thereby, consider factors, such as effectiveness, efficiency, and robustness. Our experimental results should ease the algorithm selection problem and open up new research directions.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Breiman, L. (2001) · Machine Learning · doi:10.1023/a:1010933404324 · Cited by 133,538
XGBoost: A Scalable Tree Boosting System
Chen, T., & Guestrin, C. (2016) · Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/2939672.2939785 · Cited by 54,569
The meaning and use of the area under a receiver operating characteristic (ROC) curve.
Hanley, J. A., & McNeil, B. J. (1982) · Radiology · doi:10.1148/radiology.143.1.7063747 · Cited by 21,856
Goldberger, A. L., Amaral, L. A. N., Glass, L., Hausdorff, J. M., Ivanov, P. C., Mark, R. G., Mietus, J. E., Moody, G. B., Peng, C.-K., & Stanley, H. E. (2000) · Circulation · doi:10.1161/01.cir.101.23.e215 · Cited by 14,809
Chandola, V., Banerjee, A., & Kumar, V. (2009) · ACM Computing Surveys · doi:10.1145/1541880.1541882 · Cited by 11,687 · cited 2×
“[29]): unsupervised, supervised, and semi-supervised.”
BackgroundThe use of the area under the ROC curve in the evaluation of machine learning algorithms
Bradley, A. P. (1997) · Pattern Recognition · doi:10.1016/s0031-3203(96)00142-2 · Cited by 7,217
Liu, F. T., Ting, K. M., & Zhou, Z.-H. (2008) · 2008 Eighth IEEE International Conference on Data Mining · doi:10.1109/icdm.2008.17 · Cited by 6,601
The relationship between Precision-Recall and ROC curves
Davis, J., & Goadrich, M. (2006) · Proceedings of the 23rd international conference on Machine learning - ICML '06 · doi:10.1145/1143844.1143874 · Cited by 6,559
Forecasting principles and practice
Hyndman, R. J., & Athanasopoulos, G. (2018) · Cited by 4,405
LOF: identifying density-based local outliers
Breunig, M. M., Kriegel, H.-P., Ng, R. T., & Sander, J. (2000) · Proceedings of the 2000 ACM SIGMOD international conference on Management of data · doi:10.1145/342009.335388 · Cited by 4,149 · cited 2×
“[91] SubsequenceLOF [22] Data Mining TwoFinger[90] NorM[14] DissimilarityAlgo[6] STOMP [164] Series2Graph [16] HOTSAX [70] STAMP [156] MERLIN[97] DAD[154] BoehmerGraph[13] GrammarViz [120] TARZAN [71] NormA-SJ [15] NormA-smpl[15] KnorrSeq2[102] TSBitmap [144] ILOF[108] VALMOD [82]…”
BackgroundMethodA Survey of Outlier Detection Methodologies
Hodge, V., & Austin, J. (2004) · Artificial Intelligence Review · doi:10.1007/s10462-004-4304-y · Cited by 3,596
A Fast Algorithm for the Minimum Covariance Determinant Estimator
Rousseeuw, P. J., & Driessen, K. V. (1999) · Technometrics · doi:10.1080/00401706.1999.10485670 · Cited by 2,708
Robust Anomaly Detection for Multivariate Time Series through Stochastic Recurrent Neural Network
Su, Y., Zhao, Y., Niu, C., Liu, R., Sun, W., & Pei, D. (2019) · Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining · doi:10.1145/3292500.3330672 · Cited by 1,804 · cited 4×
“reconstruction own Tensorflow OmniAnomaly [125] Deep L.”
MethodInfluentialDetecting Spacecraft Anomalies Using LSTMs and Nonparametric Dynamic Thresholding
Hundman, K., Constantinou, V., Laporte, C., Colwell, I., & Soderstrom, T. (2018) · Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining · doi:10.1145/3219819.3219845 · Cited by 1,771 · cited 5×
“9% 58 56 NASA-MSL [64] real uni 2,730 12.”
MethodInfluentialInvestigating Ad Transparency Mechanisms in Social Media: A Case Study of Facebook's Explanations
Andreou, A., Venkatadri, G., Goga, O., Gummadi, K. P., Loiseau, P., & Mislove, A. (2018) · Proceedings 2018 Network and Distributed System Security Symposium · doi:10.14722/ndss.2018.23191 · Cited by 1,477
Anomaly Detection Using Autoencoders with Nonlinear Dimensionality Reduction
Sakurada, M., & Yairi, T. (2014) · Proceedings of the MLSDA 2014 2nd Workshop on Machine Learning for Sensory Data Analysis · doi:10.1145/2689746.2689747 · Cited by 1,438
Deep Learning for Anomaly Detection: A Survey
Chalapathy, R., & Chawla, S. (2019) · arXiv · doi:10.48550/arxiv.1901.03407 · Cited by 1,240 · cited 1×
“The different anomaly types, pattern models, and time series properties led to the development of amultitude of different anomaly detection algorithms, about which various surveys exist [12, 20, 27, 28, 29, 37, 38, 53, 63].”
BackgroundMAD-GAN: Multivariate Anomaly Detection for Time Series Data with Generative Adversarial Networks
Li, D., Chen, D., Jin, B., Shi, L., Goh, J., & Ng, S.-K. (2019) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-30490-4_56 · Cited by 1,185
Efficient algorithms for mining outliers from large data sets
Ramaswamy, S., Rastogi, R., & Shim, K. (2000) · Proceedings of the 2000 ACM SIGMOD international conference on Management of data · doi:10.1145/342009.335437 · Cited by 1,171 · cited 5×
“Representatives of this category in our evaluation are: CBLOF [59], COF [130], DBStream [55], HOT SAX [70], Hybrid KNN [124], k-Means [151], KNN [110], LOF [22], NormA-SJ [15], PhaseSpaceSVM (PS-SVM) [85], SAND [17], SSA [155], STAMP [156], STOMP [164], Sub-LOF [22], VALMOD [82], and Left STAMPi [156].”
MethodInfluentialA Multimodal Anomaly Detector for Robot-Assisted Feeding Using an LSTM-Based Variational Autoencoder
Park, D., Hoshi, Y., & Kemp, C. C. (2018) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2018.2801475 · Cited by 1,115
A Review on Outlier/Anomaly Detection in Time Series Data
Blázquez-García, A., Conde, A., Mori, U., & Lozano, J. A. (2022) · ACM Computing Surveys · doi:10.1145/3444690 · Cited by 1,102
Discovering cluster-based local outliers
He, Z., Xu, X., & Deng, S. (2003) · Pattern Recognition Letters · doi:10.1016/s0167-8655(03)00003-5 · Cited by 1,055
Outlier Detection for Temporal Data: A Survey
Gupta, M., Gao, J., Aggarwal, C. C., & Han, J. (2014) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2013.184 · Cited by 1,001
Unsupervised real-time anomaly detection for streaming data
Ahmad, S., Lavin, A., Purdy, S., & Agha, Z. (2017) · Neurocomputing · doi:10.1016/j.neucom.2017.04.070 · Cited by 995
Zhang, C., Song, D., Chen, Y., Feng, X., Lumezanu, C., Cheng, W., Ni, J., Zong, B., Chen, H., & Chawla, N. V. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33011409 · Cited by 855
LOCI: fast outlier detection using the local correlation integral
Papadimitriou, S., Kitagawa, H., Gibbons, P. B., & Faloutsos, C. (2004) · Proceedings 19th International Conference on Data Engineering (Cat. No.03CH37405) · doi:10.1109/icde.2003.1260802 · Cited by 846
LSTM-based Encoder-Decoder for Multi-sensor Anomaly Detection
Malhotra, P., Ramakrishnan, A., Anand, G., Vig, L., Agarwal, P., & Shroff, G. (2016) · arXiv · doi:10.48550/arxiv.1607.00148 · Cited by 819 · cited 1×
“NormalizingFlow [116] DeepAnT [94] STORN[123] CoalESN[99] DeepNAP [72] DeepLSTM[31] HybridKNN [124] EncDec-AD [88] LSTM-basedVAE-GAN[98] LAMP[166] DAE [117] MultiHTM[146] TCN-AE[135] AD-LTI [148] LSTM-AD [89] AE [117] VELC[158] Bagel [79] HealthESN [32] MTAD-GAT [161] MoteESN[30] RADM[40] MSCRED…”
MethodUnsupervised Anomaly Detection via Variational Auto-Encoder for Seasonal KPIs in Web Applications
Xu, H., Feng, Y., Chen, J., Wang, Z., Qiao, H., Chen, W., Zhao, N., Li, Z., Bu, J., Li, Z., et al. (2018) · Proceedings of the 2018 World Wide Web Conference on World Wide Web - WWW '18 · doi:10.1145/3178876.3185996 · Cited by 808
Anomaly Detection for IoT Time-Series Data: A Survey
Cook, A. A., Misirli, G., & Fan, Z. (2020) · IEEE Internet of Things Journal · doi:10.1109/jiot.2019.2958185 · Cited by 790
Collecting complex activity datasets in highly rich networked sensor environments
Roggen, D., Calatroni, A., Rossi, M., Holleczek, T., Forster, K., Troster, G., Lukowicz, P., Bannach, D., Pirkl, G., Ferscha, A., et al. (2010) · 2010 Seventh International Conference on Networked Sensing Systems (INSS) · doi:10.1109/inss.2010.5573462 · Cited by 788
Classifier Technology and the Illusion of Progress
Hand, D. J. (2006) · Statistical Science · doi:10.1214/088342306000000060 · Cited by 723
Anomaly Detection for Discrete Sequences: A Survey
Chandola, V., Banerjee, A., & Kumar, V. (2012) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2010.235 · Cited by 715
HOT SAX: Efficiently Finding the Most Unusual Time Series Subsequence
Keogh, E., Lin, J., & Fu, A. (2006) · Fifth IEEE International Conference on Data Mining (ICDM'05) · doi:10.1109/icdm.2005.79 · Cited by 696
DeepAnT: A Deep Learning Approach for Unsupervised Anomaly Detection in Time Series
Munir, M., Siddiqui, S. A., Dengel, A., & Ahmed, S. (2019) · IEEE Access · doi:10.1109/access.2018.2886457 · Cited by 696
Wearable Assistant for Parkinson’s Disease Patients With the Freezing of Gait Symptom
Bachlin, M., Plotnik, M., Roggen, D., Maidan, I., Hausdorff, J. M., Giladi, N., & Troster, G. (2010) · IEEE Transactions on Information Technology in Biomedicine · doi:10.1109/titb.2009.2036165 · Cited by 693 · cited 1×
“1% 1 1 Daphnet [7, 41] real multi 32,594 13.”
Yeh, C.-C. M., Zhu, Y., Ulanova, L., Begum, N., Ding, Y., Dau, H. A., Silva, D. F., Mueen, A., & Keogh, E. (2016) · 2016 IEEE 16th International Conference on Data Mining (ICDM) · doi:10.1109/icdm.2016.0179 · Cited by 653
Time-Series Anomaly Detection Service at Microsoft
Ren, H., Xu, B., Wang, Y., Yi, C., Huang, C., Kou, X., Xing, T., Yang, M., Tong, J., & Zhang, Q. (2019) · Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining · doi:10.1145/3292500.3330680 · Cited by 623
Candanedo, L. M., & Feldheim, V. (2016) · Energy and Buildings · doi:10.1016/j.enbuild.2015.11.071 · Cited by 586
Aggarwal, C. C. (2017) · Springer eBooks · doi:10.1007/978-3-319-47578-3 · Cited by 566
Anomaly Detection in Streams with Extreme Value Theory
Siffer, A., Fouque, P.-A., Termier, A., & Largouet, C. (2017) · Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/3097983.3098144 · Cited by 553
Enhancing Effectiveness of Outlier Detections for Low Density Patterns
Tang, J., Chen, Z., Fu, A. W.-C., & Cheung, D. W. (2002) · Lecture Notes in Computer Science · doi:10.1007/3-540-47887-6_53 · Cited by 552
Hariri, S., Kind, M. C., & Brunner, R. J. (2021) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2019.2947676 · Cited by 501
On-Line Unsupervised Outlier Detection Using Finite Mixtures with Discounting Learning Algorithms
Yamanishi, K., Takeuchi, J.-I., Williams, G., & Milne, P. (2004) · Data Mining and Knowledge Discovery · doi:10.1023/b:dami.0000023676.72185.7c · Cited by 476
A critical investigation of recall and precision as measures of retrieval system performance
Raghavan, V., Bollmann, P., & Jung, G. S. (1989) · ACM Transactions on Information Systems · doi:10.1145/65943.65945 · Cited by 463
Anomaly detection in ECG time signals via deep long short-term memory networks
Chauhan, S., & Vig, L. (2015) · 2015 IEEE International Conference on Data Science and Advanced Analytics (DSAA) · doi:10.1109/dsaa.2015.7344872 · Cited by 405
Finding surprising patterns in a time series database in linear time and space
Keogh, E., Lonardi, S., & Chiu, B. '.-C. (2002) · Proceedings of the eighth ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/775047.775128 · Cited by 404
Time-series novelty detection using one-class support vector machines
Ma, J., & Perkins, S. (2004) · Proceedings of the International Joint Conference on Neural Networks, 2003. · doi:10.1109/ijcnn.2003.1223670 · Cited by 392
COPOD: Copula-Based Outlier Detection
Li, Z., Zhao, Y., Botta, N., Ionescu, C., & Hu, X. (2020) · 2020 IEEE International Conference on Data Mining (ICDM) · doi:10.1109/icdm50108.2020.00135 · Cited by 387
Incremental Local Outlier Detection for Data Streams
Pokrajac, D., Lazarevic, A., & Latecki, L. J. (2007) · 2007 IEEE Symposium on Computational Intelligence and Data Mining · doi:10.1109/cidm.2007.368917 · Cited by 386
Anomaly detection with density estimation
Nachman, B., & Shih, D. (2020) · Physical Review D · doi:10.1103/physrevd.101.075042 · Cited by 291
Adaptive event detection with time-varying poisson processes
Ihler, A., Hutchins, J., & Smyth, P. (2006) · Proceedings of the 12th ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/1150402.1150428 · Cited by 256
Outlier detection using isolation forest and local outlier factor
Cheng, Z., Zou, C., & Dong, J. (2019) · Proceedings of the Conference on Research in Adaptive and Convergent Systems · doi:10.1145/3338840.3355641 · Cited by 252
Zhu, Y., Zimmerman, Z., Senobari, N. S., Yeh, C.-C. M., Funning, G., Mueen, A., Brisk, P., & Keogh, E. (2016) · 2016 IEEE 16th International Conference on Data Mining (ICDM) · doi:10.1109/icdm.2016.0085 · Cited by 240
LSTM-Based VAE-GAN for Time-Series Anomaly Detection
Niu, Z., Yu, K., & Wu, X. (2020) · Sensors · doi:10.3390/s20133738 · Cited by 237
Automatic outlier detection for time series: an application to sensor data
Basu, S., & Meckesheimer, M. (2007) · Knowledge and Information Systems · doi:10.1007/s10115-006-0026-6 · Cited by 235
Condition monitoring of a complex hydraulic system using multivariate statistics
Helwig, N., Pignanelli, E., & Schutze, A. (2015) · 2015 IEEE International Instrumentation and Measurement Technology Conference (I2MTC) Proceedings · doi:10.1109/i2mtc.2015.7151267 · Cited by 226
Online novelty detection on temporal sequences
Ma, J., & Perkins, S. (2003) · Proceedings of the ninth ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/956750.956828 · Cited by 225
A statistical methodology for the design of condition indicators
Antoni, J., & Borghesani, P. (2019) · Mechanical Systems and Signal Processing · doi:10.1016/j.ymssp.2018.05.012 · Cited by 219
Budalakoti, S., Srivastava, A. N., & Otey, M. E. (2009) · IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews) · doi:10.1109/tsmcc.2008.2007248 · Cited by 192
Recent Advances in Anomaly Detection Methods Applied to Aviation
Basora, L., Olive, X., & Dubot, T. (2019) · Aerospace · doi:10.3390/aerospace6110117 · Cited by 177
Clustering Data Streams Based on Shared Density between Micro-Clusters
Hahsler, M., & Bolaos, M. (2016) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2016.2522412 · Cited by 175
A Hybrid Semi-Supervised Anomaly Detection Model for High-Dimensional Data
Song, H., Jiang, Z., Men, A., & Yang, B. (2017) · Computational Intelligence and Neuroscience · doi:10.1155/2017/8501683 · Cited by 172
Continuous monitoring of distance-based outliers over data streams
Kontaki, M., Gounaris, A., Papadopoulos, A. N., Tsichlas, K., & Manolopoulos, Y. (2011) · 2011 IEEE 27th International Conference on Data Engineering · doi:10.1109/icde.2011.5767923 · Cited by 169
Time Series Outlier Detection Based on Sliding Window Prediction
Yu, Y., Zhu, Y., Li, S., & Wan, D. (2014) · Mathematical Problems in Engineering · doi:10.1155/2014/879736 · Cited by 163
Matrix Profile XI: SCRIMP++: Time Series Motif Discovery at Interactive Speeds
Zhu, Y., Yeh, C. M., Zimmerman, Z., Kamgar, K., & Keogh, E. (2018) · Proceedings · doi:10.1109/icdm.2018.00099 · Cited by 160
Ansari, S., Farzaneh, N., Duda, M., Horan, K., Andersson, H. B., Goldberger, Z. D., Nallamothu, B. K., & Najarian, K. (2017) · IEEE Reviews in Biomedical Engineering · doi:10.1109/rbme.2017.2757953 · Cited by 152
(2018) · doi:10.1016/j.asoc.2017.06.035 · Cited by 141
SAND: streaming subsequence anomaly detection
Boniol, P., Paparrizos, J., Palpanas, T., & Franklin, M. J. M. (2021) · Proceedings of the VLDB Endowment · doi:10.14778/3467861.3467863 · Cited by 131
Series2Graph: graph-based subsequence anomaly detection for time series
Boniol, P., & Palpanas, T. (2020) · Proceedings of the VLDB Endowment · doi:10.14778/3407790.3407792 · Cited by 129
Detection and Characterization of Anomalies in Multivariate Time Series
Cheng, H., Tan, P., Potter, C. S., & Klooster, S. A. (2009) · SIAM International Conference on Data Mining · doi:10.1137/1.9781611972795.36 · Cited by 127
MERLIN: Parameter-Free Discovery of Arbitrary Length Anomalies in Massive Time Series Archives
Nakamura, T., Imamura, M., Mercer, R., & Keogh, E. (2020) · Proceedings · doi:10.1109/icdm50108.2020.00147 · Cited by 127
DILOF: Effective and Memory Efficient Local Outlier Detection in Data Streams
Na, G. S., Kim, Y., & Yu, H. (2018) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3219819.3220022 · Cited by 123
Mining for Outliers in Sequential Databases
Sun, P., Chawla, S., & Arunasalam, B. (2006) · SIAM International Conference on Data Mining · doi:10.1137/1.9781611972764.9 · Cited by 119
Learning States and Rules for Detecting Anomalies in Time Series
Salvador, S., & Chan, P. K. (2005) · Applied Intelligence · doi:10.1007/s10489-005-4610-3 · Cited by 117
Exathlon: a benchmark for explainable anomaly detection over time series
Jacob, V., Song, F., Stiegler, A., Rad, B., Diao, Y., & Tatbul, N. (2021) · Proceedings of the VLDB Endowment · doi:10.14778/3476249.3476307 · Cited by 117
Characterizing the behavior of a program using multiple-length N-grams
Marceau, C. (2001) · New Security Paradigms Workshop · doi:10.1145/366173.366197 · Cited by 116
Online anomaly detection for sensor systems: A simple and efficient approach
Yao, Y., Sharma, A. B., Golubchik, L., & Govindan, R. (2010) · Performance Evaluation · doi:10.1016/j.peva.2010.08.018 · Cited by 108
Robust and Unsupervised KPI Anomaly Detection Based on Conditional Variational Autoencoder
Li, Z., Chen, W., & Pei, D. (2018) · IEEE International Performance, Computing, and Communications Conference · doi:10.1109/pccc.2018.8710885 · Cited by 105
Multimodal execution monitoring for anomaly detection during robot manipulation
Park, D., Erickson, Z., Bhattacharjee, T., & Kemp, C. C. (2016) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2016.7487160 · Cited by 96
Hierarchical Temporal Memory method for time-series-based anomaly detection
Wu, J., Zeng, W., & Yan, F. (2017) · Neurocomputing · doi:10.1016/j.neucom.2017.08.026 · Cited by 91
Kernel Fisher Discriminants for Outlier Detection
Röth, V. (2006) · Neural Computation · doi:10.1162/neco.2006.18.4.942 · Cited by 86
Time series anomaly discovery with grammar-based compression
Senin, P., Lin, J., Wang, X., Oates, T., Gandhi, S., Boedihardjo, A. P., Chen, C., & Frankenstein, S. (2015) · Movebank · doi:10.5441/002/edbt.2015.42 · Cited by 80
Unsupervised and scalable subsequence anomaly detection in large data series
Boniol, P., Linardi, M., Roncallo, F., Palpanas, T., Meftah, M., & Rémy, E. (2021) · The VLDB Journal · doi:10.1007/s00778-021-00655-8 · Cited by 78
Zimmerman, Z., Kamgar, K., Senobari, N. S., Crites, B., Funning, G. J., Brisk, P., & Keogh, E. (2019) · ACM Symposium on Cloud Computing (SoCC) · doi:10.1145/3357223.3362721 · Cited by 74
Matrix profile goes MAD: variable-length motif and discord discovery in data series
Linardi, M., Zhu, Y., Palpanas, T., & Keogh, E. (2020) · Data Mining and Knowledge Discovery · doi:10.1007/s10618-020-00685-w · Cited by 72
Multi-perspective Anomaly Detection in Business Process Execution Events
Böhmer, K., & Rinderle‐Ma, S. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-48472-3_5 · Cited by 71
A joint model for IT operation series prediction and anomaly detection
Chen, R.-Q., Shi, G., Zhao, W., & Liang, C.-H. (2021) · Neurocomputing · doi:10.1016/j.neucom.2021.03.062 · Cited by 70
Disk Aware Discord Discovery: Finding Unusual Time Series in Terabyte Sized Datasets
Yankov, D., Keogh, E., & Rebbapragada, U. D. (2007) · Proceedings · doi:10.1109/icdm.2007.61 · Cited by 69
Automated Anomaly Detection in Large Sequences
Boniol, P., Linardi, M., Roncallo, F., & Palpanas, T. (2020) · IEEE International Conference on Data Engineering (ICDE) · doi:10.1109/icde48307.2020.00182 · Cited by 69
Multivariate-Time-Series-Driven Real-time Anomaly Detection Based on Bayesian Network
Ding, N., Gao, H., Bu, H., Ma, H., & Si, H. (2018) · Sensors · doi:10.3390/s18103367 · Cited by 65
Exact variable-length anomaly detection algorithm for univariate and multivariate time series
Wang, X., Lin, J., Patel, N. S., & Braun, M. (2018) · Data Mining and Knowledge Discovery · doi:10.1007/s10618-018-0569-7 · Cited by 60
Time Series Encodings with Temporal Convolutional Networks
Thill, M., Konen, W., & Bäck, T. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-63710-1_13 · Cited by 60
Probabilistic reasoning for streaming anomaly detection
Carter, K. M., & Streilein, W. (2012) · IEEE Statistical Signal Processing Workshop (SSP) · doi:10.1109/ssp.2012.6319708 · Cited by 57
Clustering of streaming time series is meaningless
Lin, J., Keogh, E., & Truppel, W. (2003) · ACM SIGMOD Workshop on Research Issues in Data Mining and Knowledge Discovery (DMKD) · doi:10.1145/882082.882096 · Cited by 53
DeepNAP: Deep neural anomaly pre-detection in a semiconductor fab
Kim, C., Lee, J., Kim, R., Park, Y., & Kang, J. (2018) · Information Sciences · doi:10.1016/j.ins.2018.05.020 · Cited by 47
Adaptive One-Class Support Vector Machine
Gómez-Verdejo, V., Arenas‐García, J., Lázaro-Gredilla, M., & Navia-Vázquez, A. (2011) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2011.2125961 · Cited by 45
Mote-Based Online Anomaly Detection Using Echo State Networks
Chang, M., Terzis, A., & Bonnet, P. (2009) · Lecture notes in computer science · doi:10.1007/978-3-642-02085-8_6 · Cited by 41
Multi-sphere Support Vector Data Description for Outliers Detection on Multi-distribution Data
Xiao, Y., Liu, B., Cao, L., Wu, X., Zhang, C., Hao, Z., Yang, F., & Cao, J. (2009) · IEEE ... International Conference on Data Mining workshops · doi:10.1109/icdmw.2009.87 · Cited by 39
RePAD: Real-Time Proactive Anomaly Detection for Time Series
Lee, M., Lin, J., & Gran, E. G. (2020) · Advances in intelligent systems and computing · doi:10.1007/978-3-030-44041-1_110 · Cited by 38
Fourier Transform Based Spatial Outlier Mining
Rasheed, F., Peng, P., Alhajj, R., & Rokne, J. G. (2009) · Lecture notes in computer science · doi:10.1007/978-3-642-04394-9_39 · Cited by 37
Using Echo State Networks for Anomaly Detection in Underground Coal Mines
Obst, O., Wang, X. R., & Prokopenko, M. (2008) · ACM/IEEE International Conference on Information Processing in Sensor Networks (IPSN) · doi:10.1109/ipsn.2008.35 · Cited by 36
An anomaly detection technique for business processes based on extended dynamic bayesian networks
Pauwels, S., & Calders, T. (2019) · ACM/SIGAPP Symposium on Applied Computing (SAC) · doi:10.1145/3297280.3297326 · Cited by 36
Hidden semi-Markov model for anomaly detection
Tan, X., & Xi, H. (2008) · Applied Mathematics and Computation · doi:10.1016/j.amc.2008.05.028 · Cited by 34
Study on wavelet neural network based anomaly detection in ocean observing data series
Wang, Y., Han, L., Liu, W., Yang, S., & Gao, Y. (2019) · Ocean Engineering · doi:10.1016/j.oceaneng.2019.106129 · Cited by 34
Imbalanced dataset-based echo state networks for anomaly detection
Chen, Q., Zhang, A., Huang, T., He, Q., & Song, Y. (2018) · Neural Computing and Applications · doi:10.1007/s00521-018-3747-z · Cited by 33
Wang, X., Lin, J., Patel, N. S., & Braun, M. (2016) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/2983323.2983344 · Cited by 27
Ogbechie, A., Díaz-Rozo, J., Larrañaga, P., & Bielza, C. (2016) · Springer eBooks · doi:10.1007/978-3-662-53806-7_3 · Cited by 26
An improved Hidden Markov Model for anomaly detection using frequent common patterns
Sultana, A., Hamou‐Lhadj, A., & Couture, M. (2012) · International Conference on Communications · doi:10.1109/icc.2012.6364527 · Cited by 24
Anomaly Detection and Localization for Cyber-Physical Production Systems with Self-Organizing Maps
von Birgelen, A., & Niggemann, O. (2018) · Technologien für die intelligente Automation · doi:10.1007/978-3-662-57805-6_4 · Cited by 18
Time Series Clustering and Classification
Chen, M. (2020) · Journal of the American Statistical Association · doi:10.1080/01621459.2020.1801281 · Cited by 18
Distributed detection of sequential anomalies in univariate time series
Schneider, J., Wenig, P., & Papenbrock, T. (2021) · The VLDB Journal · doi:10.1007/s00778-021-00657-6 · Cited by 16
Self-citationDistance-Based Outliers in Sequences
Palshikar, G. K. (2005) · Lecture notes in computer science · doi:10.1007/11604655_61 · Cited by 13
Gas Turbine Engine Condition Monitoring Using Gaussian Mixture and Hidden Markov Models
Jacobs, W. R., Edwards, H. L., Li, P., Kadirkamanathan, V., & Mills, A. R. (2020) · International Journal of Prognostics and Health Management · doi:10.36001/ijphm.2018.v9i2.2734 · Cited by 12
Tripathi, A. M., & Baruah, R. D. (2019) · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/smc.2019.8914477 · Cited by 8
Anomaly Detection with HMM Gauge Likelihood Analysis
Lorbeer, B., Deutsch, T., Ruppel, P., & Küpper, A. (2019) · IEEE International Conference on Big Data Computing Service and Applications (BigDataService) · doi:10.1109/bigdataservice.2019.00008 · Cited by 5
Thill, M., Konen, W., & Bäck, T. (2018) · Repository KITopen (Karlsruhe Institute of Technology) · doi:10.5445/ksp/1000087327/04 · Cited by 5
Adjacent Mean Difference (AMD) method for dynamic segmentation in time series anomaly detection
Yang, C.-L., & Liao, W.-J. (2017) · IEEE/SICE International Symposium on System Integration (SII) · doi:10.1109/sii.2017.8279219 · Cited by 4
Cited by
DCdetector: Dual Attention Contrastive Representation Learning for Time Series Anomaly Detection
Yang, Y., Zhang, C., Zhou, T., Wen, Q., & Sun, L. (2023) · Proceedings of the 29th ACM SIGKDD Conference on Knowledge Discovery and Data Mining · doi:10.1145/3580305.3599295 · Cited by 387
ImDiffusion: Imputed Diffusion Models for Multivariate Time Series Anomaly Detection
Chen, Y., Zhang, C., Ma, M., Liu, Y., Ding, R., Li, B., He, S., Rajmohan, S., Lin, Q., & Zhang, D. (2023) · Proceedings of the VLDB Endowment · doi:10.14778/3632093.3632101 · Cited by 139
Navigating the metric maze: a taxonomy of evaluation metrics for anomaly detection in time series
Sørbø, S., & Ruocco, M. (2024) · Data Mining and Knowledge Discovery · doi:10.1007/s10618-023-00988-8 · Cited by 58
“In our experiments, we only consider the point-wise precision and recall for the PR curve, as is by far most used, although any other pairs can be used, like the point-adjusted AUCPR by [55] or the range based AUCPR by [20].”
InfluentialSiET: Spatial information enhanced transformer for multivariate time series anomaly detection
Xiong, W., Wang, P., Sun, X., & Wang, J. (2024) · Knowledge-Based Systems · doi:10.1016/j.knosys.2024.111928 · Cited by 32
Auto-Validate by-History: Auto-Program Data Quality Constraints to Validate Recurring Data Pipelines
Tu, D., He, Y., Cui, W., Ge, S., Zhang, H., Han, S., Zhang, D., & Chaudhuri, S. (2023) · Proceedings of the 29th ACM SIGKDD Conference on Knowledge Discovery and Data Mining · doi:10.1145/3580305.3599776 · Cited by 14
Metadata
- Authors
- Schmidl, S., Wenig, P., & Papenbrock, T.
- Venue
- Proceedings of the VLDB Endowment
- Published
- 2022-05
- Volume
- 15
- Issue
- 9
- Pages
- 1779-1797
- ISSN
- 2150-8097 (ISSN-L)
- OpenAlex
- W4288057688
- Cited by
- 590
- References
- 117
- FWCI
- 35.46
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.