The DOI matches its Crossref record; 26 of the 26 references it cites were found in a registry or an index.
Generic and Scalable Framework for Automated Time-series Anomaly Detection
Abstract
This paper introduces a generic and scalable framework for automated anomaly detection on large scale time-series data. Early detection of anomalies plays a key role in maintaining consistency of person's data and protects corporations against malicious attackers. Current state of the art anomaly detection approaches suffer from scalability, use-case restrictions, difficulty of use and a large number of false positives. Our system at Yahoo, EGADS, uses a collection of anomaly detection and forecasting models with an anomaly filtering layer for accurate and scalable anomaly detection on time-series. We compare our approach against other anomaly detection systems on real and synthetic data with varying time-series characteristics. We found that our framework allows for 50-60% improvement in precision and recall for a variety of use-cases. Both the data and the framework are being open-sourced. The open-sourcing of the data, in particular, represents the first of its kind effort to establish the standard benchmark for anomaly detection.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A decision-theoretic generalization of on-line learning and an application to boosting
Freund, Y., & Schapire, R. E. (1997) · Journal of Computer and System Sciences · doi:10.1006/jcss.1997.1504 · Cited by 20,466
Chandola, V., Banerjee, A., & Kumar, V. (2009) · ACM Computing Surveys · doi:10.1145/1541880.1541882 · Cited by 11,687 · cited 2×
“Use-case, or category specific, anomaly detection models [4] may enjoy a low false positive rate for a specific application, but when the characteristics of the time-series change, these techniques perform poorly without proper retraining.”
BackgroundInformation theory and statistics
(1959) · Journal of the Franklin Institute · doi:10.1016/0016-0032(59)90368-0 · Cited by 7,094
Another look at measures of forecast accuracy
Hyndman, R. J., & Koehler, A. B. (2006) · International Journal of Forecasting · doi:10.1016/j.ijforecast.2006.03.001 · Cited by 5,757
LOF: identifying density-based local outliers
Breunig, M. M., Kriegel, H.-P., Ng, R. T., & Sander, J. (2000) · ACM SIGMOD Record · doi:10.1145/335191.335388 · Cited by 5,207
Time Series Analysis by State Space Methods: Second Edition
Durbin, J., & Koopman, S. J. (2012) · doi:10.1093/acprof:oso/9780199641178.001.0001 · Cited by 3,301
Wavelet Methods for Time SeriesAnalysis
Percival, D. B., & Walden, A. T. (2000) · Cambridge University Press eBooks · doi:10.1017/cbo9780511841040 · Cited by 3,065
Wavelet methods for time series analysis
(2001) · Choice Reviews Online · doi:10.5860/choice.38-4508 · Cited by 2,574
Kalman Filtering and Neural Networks
(2001) · Wiley eBooks · doi:10.1002/0471221546 · Cited by 2,386
STL : A Seasonal-Trend Decomposition Procedure Based on Loess
Cleveland, R. B. (1990) · Medical Entomology and Zoology · Cited by 2,244
Non-Parametric Estimation of a Multivariate Probability Density
Epanechnikov, V. A. (1969) · Theory of Probability & Its Applications · doi:10.1137/1114019 · Cited by 1,835
Fourier Analysis of Time Series: An Introduction
Stoffer, D. S., & Bloomfield, P. (2000) · Journal of the American Statistical Association · doi:10.2307/2669794 · Cited by 1,690
Percentage Points for a Generalized ESD Many-Outlier Procedure
Rosner, B. (1983) · Technometrics · doi:10.1080/00401706.1983.10487848 · Cited by 1,268
Toshniwal, A., Taneja, S., Shukla, A., Ramasamy, K., Patel, J. M., Kulkarni, S., Jackson, J., Gade, K., Fu, M., Donham, J., et al. (2014) · Proceedings of the 2014 ACM SIGMOD International Conference on Management of Data · doi:10.1145/2588555.2595641 · Cited by 956
Aggarwal, C. C. (2013) · Cited by 832
Fourier Analysis of Time Series: An Introduction
Bloomfield, P., & Yuen, C. (1977) · IEEE Transactions on Systems, Man, and Cybernetics · doi:10.1109/tsmc.1977.4309709 · Cited by 708
Change-point detection in time-series data by relative density-ratio estimation
Liu, S., Yamada, M., Collier, N., & Sugiyama, M. (2013) · Neural Networks · doi:10.1016/j.neunet.2013.01.012 · Cited by 447
Wei, W. W. S. (2013) · Oxford Handbooks Online · doi:10.1093/oxfordhb/9780199934898.013.0022 · Cited by 239
An Algorithm Based on Singular Spectrum Analysis for Change-Point Detection
Moskvina, V., & Zhigljavsky, A. (2003) · Communications in Statistics - Simulation and Computation · doi:10.1081/sac-120017494 · Cited by 220
Information Theory and Statistics
Haroutunian, E. (2011) · International Encyclopedia of Statistical Science · doi:10.1007/978-3-642-04898-2_643 · Cited by 219
Wang, X., Smith-Miles, K., & Hyndman, R. (2009) · Neurocomputing · doi:10.1016/j.neucom.2008.10.017 · Cited by 175
A novel technique for long-term anomaly detection in the cloud
Vallis, O., Hochenbaum, J., & Kejariwal, A. (2014) · IEEE International Conference on Cloud Computing Technology and Science · Cited by 167
Change-Point Detection for High-Dimensional Time Series With Missing Data
Xie, Y., Huang, J., & Willett, R. M. (2012) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2012.2234082 · Cited by 152
Change-Point Detection in Time-Series Data Based on Subspace Identification
Kawahara, Y., Yairi, T., & Machida, K. (2007) · Proceedings · doi:10.1109/icdm.2007.78 · Cited by 113
Toward Automated Anomaly Identification in Large-Scale Systems
Lan, Z., Zheng, Z., & Li, Y. (2009) · IEEE Transactions on Parallel and Distributed Systems · doi:10.1109/tpds.2009.52 · Cited by 105
Black Box Anomaly Detection: is it Utopian?
Venkataraman, S., Caballero, J., Song, D. X., Blum, A. L., & Yates, J. M. (2018) · Figshare · doi:10.1184/r1/6468443 · Cited by 10
Cited by
Robust Anomaly Detection for Multivariate Time Series through Stochastic Recurrent Neural Network
Su, Y., Zhao, Y., Niu, C., Liu, R., Sun, W., & Pei, D. (2019) · Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining · doi:10.1145/3292500.3330672 · Cited by 1,804
“Industry devices, such as server machines [9, 14], spacecrafts [6], robot-assisted systems [16, 17], engines [11], are typically monitored with multiple time series metrics (also called telemetry data, sensor data, etc.”
BackgroundA Review on Outlier/Anomaly Detection in Time Series Data
Blázquez-García, A., Conde, A., Mori, U., & Lozano, J. A. (2022) · ACM Computing Surveys · doi:10.1145/3444690 · Cited by 1,102
“[2008, 2009] Estimation Multivariate ✗ ✗ A Li et al. [2009] Dissimilarity Univariate ✓ ✓ O Sakurada and Yairi [2014] Estimation Multivariate ✗ ✗ A Zhou et al.”
BackgroundUnsupervised real-time anomaly detection for streaming data
Ahmad, S., Lavin, A., Purdy, S., & Agha, Z. (2017) · Neurocomputing · doi:10.1016/j.neucom.2017.04.070 · Cited by 995
A Unifying Review of Deep and Shallow Anomaly Detection
Ruff, L., Kauffmann, J. R., Vandermeulen, R. A., Montavon, G., Samek, W., Kloft, M., Dietterich, T. G., & Muller, K.-R. (2021) · Proceedings of the IEEE · doi:10.1109/jproc.2021.3052449 · Cited by 914
Machine Learning for Anomaly Detection: A Systematic Review
Nassif, A. B., Talib, M. A., Nasir, Q., & Dakalbab, F. M. (2021) · IEEE Access · doi:10.1109/access.2021.3083060 · Cited by 748
Metadata
- Authors
- Laptev, N., Amizadeh, S., & Flint, I.
- Venue
- Proceedings of the 21th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining
- Publisher
- ACM
- Published
- 2015-08-10
- Pages
- 1939-1947
- OpenAlex
- W2093606067
- Cited by
- 425
- References
- 26
- FWCI
- 11.17
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.