The DOI matches its Crossref record; 55 of the 55 references it cites were found in a registry or an index.
Unsupervised real-time anomaly detection for streaming data
Open accessAbstract
We are seeing an enormous increase in the availability of streaming, time-series data. Largely driven by the rise of connected real-time data sources, this data presents technical challenges and opportunities. One fundamental capability for streaming analytics is to model each stream in an unsupervised fashion and detect unusual, anomalous behaviors in real-time. Early anomaly detection is valuable, yet it can be difficult to execute reliably in practice. Application constraints require systems to process data in real-time, not batches. Streaming data inherently exhibits concept drift, favoring algorithms that learn continuously. Furthermore, the massive number of independent streams in practice requires that anomaly detectors be fully automated. In this paper we propose a novel anomaly detection algorithm that meets these constraints. The technique is based on an online sequence memory algorithm called Hierarchical Temporal Memory (HTM). We also present results using the Numenta Anomaly Benchmark (NAB), a benchmark containing real-world data streams with labeled anomalies. The benchmark, the first of its kind, provides a controlled open-source environment for testing anomaly detection algorithms on streaming data. We present results and analysis for a wide range of algorithms on this benchmark, and discuss future challenges for the emerging field of streaming analytics.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Chandola, V., Banerjee, A., & Kumar, V. (2009) · ACM Computing Surveys · doi:10.1145/1541880.1541882 · Cited by 11,687
Space/time trade-offs in hash coding with allowable errors
Bloom, B. H. (1970) · Communications of the ACM · doi:10.1145/362686.362692 · Cited by 7,492
A survey on concept drift adaptation
Gama, J., Žliobaitė, I., Bifet, A., Pechenizkiy, M., & Bouchachia, A. (2014) · ACM Computing Surveys · doi:10.1145/2523813 · Cited by 3,735
Automatic Time Series Forecasting: The forecast Package for R
Hyndman, R. J., & Khandakar, Y. (2008) · Journal of Statistical Software · doi:10.18637/jss.v027.i03 · Cited by 3,511
Bleiholder, J., & Naumann, F. (2009) · ACM Computing Surveys · doi:10.1145/1456650.1456651 · Cited by 1,838
Pimentel, M. A. F., Clifton, D. A., Clifton, L., & Tarassenko, L. (2014) · Signal Processing · doi:10.1016/j.sigpro.2013.12.026 · Cited by 1,649
Long Short Term Memory Networks for Anomaly Detection in Time Series.
Malhotra, P., Vig, L., Shroff, G. M., & Agarwal, P. (2015) · The European Symposium on Artificial Neural Networks · Cited by 1,259
Diagnosing network-wide traffic anomalies
Lakhina, A., Crovella, M., & Diot, C. (2004) · Proceedings of the 2004 conference on Applications, technologies, architectures, and protocols for computer communications · doi:10.1145/1015467.1015492 · Cited by 1,039
Proceedings Of The International Joint Conference On Neural Networks 2003
(2003) · Proceedings of the International Joint Conference on Neural Networks, 2003. · doi:10.1109/ijcnn.2003.1223944 · Cited by 950
Gaber, M. M., Zaslavsky, A., & Krishnaswamy, S. (2005) · ACM SIGMOD Record · doi:10.1145/1083784.1083789 · Cited by 886
Fox, A. J. (1972) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1972.tb00912.x · Cited by 756
Proceedings 2002 IEEE International Conference on Data Mining. ICDM 2002
(2002) · 2002 IEEE International Conference on Data Mining, 2002. Proceedings. · doi:10.1109/icdm.2002.1183878 · Cited by 727
HOT SAX: Efficiently Finding the Most Unusual Time Series Subsequence
Keogh, E., Lin, J., & Fu, A. (2006) · Fifth IEEE International Conference on Data Mining (ICDM'05) · doi:10.1109/icdm.2005.79 · Cited by 696
Bayesian Online Changepoint Detection
Adams, R. P., & MacKay, D. J. C. (2007) · arXiv · doi:10.48550/arxiv.0710.3742 · Cited by 601
Knowledge Discovery in Data Streams
(2009) · Encyclopedia of Library and Information Sciences, Third Edition · doi:10.1081/e-elis3-120043643 · Cited by 551
Evaluating Real-Time Anomaly Detection Algorithms -- The Numenta Anomaly Benchmark
Lavin, A., & Ahmad, S. (2015) · 2015 IEEE 14th International Conference on Machine Learning and Applications (ICMLA) · doi:10.1109/icmla.2015.141 · Cited by 457
Self-citationGeneric and Scalable Framework for Automated Time-series Anomaly Detection
Laptev, N., Amizadeh, S., & Flint, I. (2015) · Proceedings of the 21th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/2783258.2788611 · Cited by 425
Diagnosing network-wide traffic anomalies
Lakhina, A., Crovella, M., & Diot, C. (2004) · ACM SIGCOMM Computer Communication Review · doi:10.1145/1030194.1015492 · Cited by 419
Why Neurons Have Thousands of Synapses, a Theory of Sequence Memory in Neocortex
Hawkins, J., & Ahmad, S. (2016) · Frontiers in Neural Circuits · doi:10.3389/fncir.2016.00023 · Cited by 396
Self-citationToward Supervised Anomaly Detection
Goernitz, N., Kloft, M., Rieck, K., & Brefeld, U. (2013) · Journal of Artificial Intelligence Research · doi:10.1613/jair.3623 · Cited by 371
Loda: Lightweight on-line detector of anomalies
Pevný, T. (2016) · Machine Learning · doi:10.1007/s10994-015-5521-0 · Cited by 357
(2013) · doi:10.1109/infocom20487.2013 · Cited by 345
Combining Filtering and Statistical Methods for Anomaly Detection
Soule, A., Salamatian, K., & Taft, N. (2005) · Cited by 258
Proceedings of the 28th Annual ACM Symposium on Applied Computing
(2013) · doi:10.1145/2480362 · Cited by 249
Continuous Online Sequence Learning with an Unsupervised Neural Network Model
Cui, Y., Ahmad, S., & Hawkins, J. (2016) · Neural Computation · doi:10.1162/neco_a_00893 · Cited by 239
Self-citationAnomaly Detection via Online Oversampling Principal Component Analysis
Lee, Y.-J., Yeh, Y.-R., & Wang, Y.-C. F. (2013) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2012.99 · Cited by 225
スマート・データプライニングの概観:過去のプロポーザル,現在のプラン,今後の傾向
Soumya, S., Carlee, J.-W., Ha, S., & Chiang, M. (2013) · ACM Computing Surveys · Cited by 179
Statistical techniques for online anomaly detection in data centers
Wang, C., Viswanathan, K., Choudur, L., Talwar, V., Satterfield, W., & Schwan, K. (2011) · 12th IFIP/IEEE International Symposium on Integrated Network Management (IM 2011) and Workshops · doi:10.1109/inm.2011.5990537 · Cited by 178
Proceedings of the 17 th International Conference on Pattern Recognition
(2004) · Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004. · doi:10.1109/icpr.2004.1333675 · Cited by 178
Ahmad, S., & Hawkins, J. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1503.07469 · Cited by 172
Self-citationComparative Evaluation of Anomaly Detection Techniques for Sequence Data
Chandola, V., Mithal, V., & Kumar, V. (2008) · 2008 Eighth IEEE International Conference on Data Mining · doi:10.1109/icdm.2008.151 · Cited by 167
Outlier Detection in Regression Models with ARIMA Errors using Robust Estimates
Bianco, A. M., García Ben, M., Martínez, E. J., & Yohai, V. J. (2001) · Journal of Forecasting · doi:10.1002/for.768 · Cited by 166
Finding anomalous periodic time series: An application to catalogs of periodic variable stars
Rebbapragada, U. D., Protopapas, P., Brodley, C. E., & Alcock, C. R. (2008) · Machine Learning · doi:10.1007/s10994-008-5093-3 · Cited by 166
The HTM Spatial Pooler—A Neocortical Algorithm for Online Sparse Distributed Coding
Cui, Y., Ahmad, S., & Hawkins, J. (2017) · Frontiers in Computational Neuroscience · doi:10.3389/fncom.2017.00111 · Cited by 159
Self-citationValiullina, F., Akhmetshina, D., Nasretdinov, A., Mukhtarov, M. R., Valeeva, G. R., Khazipov, R., & Rozov, A. V. (2016) · Frontiers in Neural Circuits · doi:10.3389/fncir.2016.00001 · Cited by 153
Knowledge Discovery from Data Streams
(2010) · Chapman & Hall/CRC data mining and knowledge discovery series · doi:10.1201/ebk1439826119-c1 · Cited by 152
An Incremental Learning of Concept Drifts Using Evolving Type-2 Recurrent Fuzzy Neural Networks
Pratama, M., Lü, J., Lughofer, E. D., et al. (2016) · IEEE Transactions on Fuzzy Systems · doi:10.1109/tfuzz.2016.2599855 · Cited by 150
Distributed Real-Time Anomaly Detection in Networked Industrial Sensing Systems
Chen, P.-Y., Yang, S., & McCann, J. A. (2015) · IEEE Transactions on Industrial Electronics · doi:10.1109/tie.2014.2350451 · Cited by 148
Multivariate Online Anomaly Detection Using Kernel Recursive Least Squares
Ahmed, T., Coates, M., & Lakhina, A. (2007) · IEEE INFOCOM 2007 - 26th IEEE International Conference on Computer Communications · doi:10.1109/infcom.2007.79 · Cited by 148
Anomaly detection based on eccentricity analysis
Angelov, P. P. (2014) · IEEE Symposium on Evolving and Autonomous Learning Systems (EALS) · doi:10.1109/eals.2014.7009497 · Cited by 121
pClass: An Effective Classifier for Streaming Examples
Pratama, M., Anavatti, S. G., Joo, M., & Lughofer, E. D. (2014) · IEEE Transactions on Fuzzy Systems · doi:10.1109/tfuzz.2014.2312983 · Cited by 107
Probabilistic anomaly detection in natural gas time series data
Akouemo, H. N., & Povinelli, R. J. (2015) · International Journal of Forecasting · doi:10.1016/j.ijforecast.2015.06.001 · Cited by 93
Proceedings of the 6th ACM SIGCOMM conference on Internet measurement
Almeida, J., Brazil, I. I. M. C. 2. R. D. J., Association for Computing Machinery-Digital Library, ACM Special Interest Group on Data Communication, & SIGs, A. (2006) · doi:10.1145/1177080 · Cited by 85
Encoding Data for HTM SystemsPreprint
Purdy, S. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1602.05925 · Cited by 76
Self-citationNovelty detection algorithm for data streams multi-class problems
Faria, E. R., da Gama, J. M. P., & de Carvalho, A. C. P. L. F. (2013) · ACM Symposium on Applied Computing · doi:10.1145/2480362.2480515 · Cited by 73
Self-adaptive and dynamic clustering for online anomaly detection
Lee, S. M., Kim, G., & Kim, S. H. (2011) · Expert Systems with Applications · doi:10.1016/j.eswa.2011.05.058 · Cited by 72
Adaptive Kalman Filtering for anomaly detection in software appliances
Knorn, F., & Leith, D. J. (2008) · IEEE Conference on Computer Communications Workshops (INFOCOM WKSHPS) · doi:10.1109/infocom.2008.4544581 · Cited by 62
Bernieri, A., Betta, G., & Liguori, C. (1996) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/19.536707 · Cited by 61
Expected similarity estimation for large-scale batch and streaming anomaly detection
Schneider, M., Ertel, W., & Ramos, F. T. (2016) · Machine Learning · doi:10.1007/s10994-016-5567-7 · Cited by 61
Scaffolding type-2 classifier for incremental learning under concept drifts
Pratama, M., Lü, J., Lughofer, E. D., Zhang, G., & Anavatti, S. G. (2016) · Neurocomputing · doi:10.1016/j.neucom.2016.01.049 · Cited by 60
A Mathematical Formalization of Hierarchical Temporal Memory’s Spatial Pooler
Mnatzaganian, J., Fokoué, E., & Kudithipudi, D. (2017) · Frontiers in Robotics and AI · doi:10.3389/frobt.2016.00081 · Cited by 44
On-line novelty detection using the Kalman filter and extreme value theory
Lee, H., & Roberts, S. (2008) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr.2008.4761918 · Cited by 39
Online fault detection based on Typicality and Eccentricity Data Analytics
Costa, B. S. J., Bezerra, C. G., Guedes, L. A., & Angelov, P. P. (2015) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2015.7280712 · Cited by 32
Extending the bioinspired hierarchical temporal memory paradigm for sign language recognition
Rozado, D., Rodríguez, F. B., & Varona, P. (2011) · Neurocomputing · doi:10.1016/j.neucom.2011.10.005 · Cited by 31
Performance of a hierarchical temporal memory network in noisy sequence learning
Padilla, D. E., Brinkworth, R. S. A., & McDonnell, M. D. (2013) · IEEE International Conference on Cybernetics and Computational Intelligence (CyberneticsCom) · doi:10.1109/cyberneticscom.2013.6865779 · Cited by 22
Cited by
Detecting Spacecraft Anomalies Using LSTMs and Nonparametric Dynamic Thresholding
Hundman, K., Constantinou, V., Laporte, C., Colwell, I., & Soderstrom, T. (2018) · Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining · doi:10.1145/3219819.3219845 · Cited by 1,771
Deep Learning for Anomaly Detection: A Survey
Chalapathy, R., & Chawla, S. (2019) · arXiv · doi:10.48550/arxiv.1901.03407 · Cited by 1,240
A Review on Outlier/Anomaly Detection in Time Series Data
Blázquez-García, A., Conde, A., Mori, U., & Lozano, J. A. (2022) · ACM Computing Surveys · doi:10.1145/3444690 · Cited by 1,102
TranAD: deep transformer networks for anomaly detection in multivariate time series data
Tuli, S., Casale, G., & Jennings, N. R. (2022) · Proceedings of the VLDB Endowment · doi:10.14778/3514061.3514067 · Cited by 1,063
A Unifying Review of Deep and Shallow Anomaly Detection
Ruff, L., Kauffmann, J. R., Vandermeulen, R. A., Montavon, G., Samek, W., Kloft, M., Dietterich, T. G., & Muller, K.-R. (2021) · Proceedings of the IEEE · doi:10.1109/jproc.2021.3052449 · Cited by 914
Metadata
- Authors
- Ahmad, S., Lavin, A., Purdy, S., & Agha, Z.
- Venue
- Neurocomputing
- Publisher
- Elsevier BV
- Published
- 2017-11
- Volume
- 262
- Pages
- 134-147
- ISSN
- 0925-2312 (ISSN-L)
- OpenAlex
- W2620661538
- Cited by
- 995
- References
- 55
- FWCI
- 50.02
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.