The DOI matches its Crossref record; 22 of the 22 references it cites were found in a registry or an index.
Anomaly Detection with Robust Deep Autoencoders
Abstract
Deep autoencoders, and other deep neural networks, have demonstrated their effectiveness in discovering non-linear features across many problem domains. However, in many real-world problems, large outliers and pervasive noise are commonplace, and one may not have access to clean training data as required by standard deep denoising autoencoders. Herein, we demonstrate novel extensions to deep autoencoders which not only maintain a deep autoencoders' ability to discover high quality, non-linear features but can also eliminate outliers and noise without access to any clean training data. Our model is inspired by Robust Principal Component Analysis, and we split the input data X into two parts, $X = L_{D} + S$, where $L_{D}$ can be effectively reconstructed by a deep autoencoder and $S$ contains the outliers and noise in the original data X. Since such splitting increases the robustness of standard deep autoencoders, we name our model a "Robust Deep Autoencoder (RDA)". Further, we present generalizations of our results to grouped sparsity norms which allow one to distinguish random anomalies from other types of structured corruptions, such as a collection of features being corrupted across many instances or a collection of instances having more corruptions than their fellows. Such "Group Robust Deep Autoencoders (GRDA)" give rise to novel anomaly detection approaches whose superior performance we demonstrate on a selection of benchmark problems.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
Scikit-learn: Machine Learning in Python
Pedregosa, F., Varoquaux, G., Gramfort, A., Michel, V., Thirion, B., Grisel, O., Blondel, M., Müller, A., Nothman, J., Louppe, G., et al. (2012) · arXiv · doi:10.48550/arxiv.1201.0490 · Cited by 71,016
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805
Boyd, S., & Vandenberghe, L. (2004) · doi:10.1017/cbo9780511804441 · Cited by 56,601
Learning representations by back-propagating errors
Rumelhart, D. E., Hinton, G. E., & Williams, R. J. (1986) · Nature · doi:10.1038/323533a0 · Cited by 31,892
Boyd, S. (2010) · now publishers, Inc. eBooks · doi:10.1561/9781601984616 · Cited by 12,677
(2016) · Cited by 11,679
TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems
Abadi, M., Agarwal, A., Barham, P., Brevdo, E., Chen, Z., Citro, C., Corrado, G. S., Davis, A., Dean, J., Devin, M., et al. (2016) · arXiv · doi:10.48550/arxiv.1603.04467 · Cited by 9,408
Extracting and composing robust features with denoising autoencoders
Vincent, P., Larochelle, H., Bengio, Y., & Manzagol, P.-A. (2008) · Proceedings of the 25th international conference on Machine learning - ICML '08 · doi:10.1145/1390156.1390294 · Cited by 7,436
Liu, F. T., Ting, K. M., & Zhou, Z.-H. (2008) · 2008 Eighth IEEE International Conference on Data Mining · doi:10.1109/icdm.2008.17 · Cited by 6,601
Cited by
Gong, D., Liu, L., Le, V., Saha, B., Mansour, M. R., Venkatesh, S., & Van Den Hengel, A. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00179 · Cited by 1,930
Scientific discovery in the age of artificial intelligence.
Wang, H., Fu, T., Du, Y., Gao, W., Huang, K., Liu, Z., Chandak, P., Liu, S., Van Katwyk, P., Deac, A., et al. (2023) · Nature · doi:10.1038/s41586-023-06221-2 · Cited by 1,823
Deep Learning in Mobile and Wireless Networking: A Survey
Zhang, C., Patras, P., & Haddadi, H. (2019) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2019.2904897 · Cited by 1,768
Deep Learning for Anomaly Detection: A Survey
Chalapathy, R., & Chawla, S. (2019) · arXiv · doi:10.48550/arxiv.1901.03407 · Cited by 1,240
A Unifying Review of Deep and Shallow Anomaly Detection
Ruff, L., Kauffmann, J. R., Vandermeulen, R. A., Montavon, G., Samek, W., Kloft, M., Dietterich, T. G., & Muller, K.-R. (2021) · Proceedings of the IEEE · doi:10.1109/jproc.2021.3052449 · Cited by 914
Zhang, C., Song, D., Chen, Y., Feng, X., Lumezanu, C., Cheng, W., Ni, J., Zong, B., Chen, H., & Chawla, N. V. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33011409 · Cited by 855
A Comprehensive Survey on Graph Anomaly Detection With Deep Learning
Ma, X., Wu, J., Xue, S., Yang, J., Zhou, C., Sheng, Q. Z., Xiong, H., & Akoglu, L. (2023) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2021.3118815 · Cited by 835
Self-citationMachine Learning for Anomaly Detection: A Systematic Review
Nassif, A. B., Talib, M. A., Nasir, Q., & Dakalbab, F. M. (2021) · IEEE Access · doi:10.1109/access.2021.3083060 · Cited by 748
Recurrent Neural Networks: A Comprehensive Review of Architectures, Variants, and Applications
Mienye, I. D., Swart, T. G., & Obaido, G. (2024) · Information · doi:10.3390/info15090517 · Cited by 732
Theissler, A., Pérez-Velázquez, J., Kettelgerdes, M., & Elger, G. (2021) · Reliability Engineering & System Safety · doi:10.1016/j.ress.2021.107864 · Cited by 581
Attributed Graph Clustering: A Deep Attentional Embedding Approach
Wang, C., Pan, S., Hu, R., Long, G., Jiang, J., & Zhang, C. (2019) · Proceedings of the Twenty-Eighth International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2019/509 · Cited by 573
Deep Anomaly Detection on Attributed Networks
Ding, K., Li, J., Bhanushali, R., & Liu, H. (2019) · Proceedings of the 2019 SIAM International Conference on Data Mining · doi:10.1137/1.9781611975673.67 · Cited by 548
Progress in Outlier Detection Techniques: A Survey
Wang, H., Bah, M. J., & Hammad, M. (2019) · IEEE Access · doi:10.1109/access.2019.2932769 · Cited by 523
Robust Deep Learning Methods for Anomaly Detection
Chalapathy, R., Khoa, N. L. D., & Chawla, S. (2020) · Proceedings of the 26th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining · doi:10.1145/3394486.3406704 · Cited by 502
Explaining anomalies detected by autoencoders using Shapley Additive Explanations
Antwarg, L., Miller, R. M., Shapira, B., & Rokach, L. (2021) · Expert Systems with Applications · doi:10.1016/j.eswa.2021.115736 · Cited by 496
Classification-Reconstruction Learning for Open-Set Recognition
Yoshihashi, R., Shao, W., Kawakami, R., You, S., Iida, M., & Naemura, T. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00414 · Cited by 472
Efficient GAN-Based Anomaly Detection
Zenati, H., Foo, C.-S., Lecouat, B., Manek, G., & Chandrasekhar, V. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1802.06222 · Cited by 460
A survey on anomaly detection for technical systems using LSTM networks
Lindemann, B., Maschler, B., Sahlab, N., & Weyrich, M. (2021) · Computers in Industry · doi:10.1016/j.compind.2021.103498 · Cited by 445
Deep Anomaly Detection with Deviation Networks
Pang, G., Shen, C., & van den Hengel, A. (2019) · Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining · doi:10.1145/3292500.3330871 · Cited by 439
Practical Approach to Asynchronous Multivariate Time Series Anomaly Detection and Localization
Abdulaal, A., Liu, Z., & Lancewicki, T. (2021) · Proceedings of the 27th ACM SIGKDD Conference on Knowledge Discovery & Data Mining · doi:10.1145/3447548.3467174 · Cited by 423
Adversarially Learned Anomaly Detection
Zenati, H., Romain, M., Foo, C.-S., Lecouat, B., & Chandrasekhar, V. (2018) · 2018 IEEE International Conference on Data Mining (ICDM) · doi:10.1109/icdm.2018.00088 · Cited by 397
Bouwmans, T., Javed, S., Sultana, M., & Jung, S. K. (2019) · Neural Networks · doi:10.1016/j.neunet.2019.04.024 · Cited by 396
Viral pneumonia screening on chest X-rays using confidence-aware anomaly detection
Zhang, J., Xie, Y., Pang, G., Liao, Z., Verjans, J., Li, W., Sun, Z., He, J., Li, Y., Shen, C., et al. (2021) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2020.3040950 · Cited by 389
“labeled anomaly data than binary classification [17]–[19].”
Smart Anomaly Detection in Sensor Systems: A Multi-Perspective Review
Erhan, L., Ndubuaku, M., Di Mauro, M., Song, W., Chen, M., Fortino, G., Bagdasar, O., & Liotta, A. (2021) · Information Fusion · doi:10.1016/j.inffus.2020.10.001 · Cited by 378
Wu, Y., Sicard, B., & Gadsden, S. A. (2024) · Expert Systems with Applications · doi:10.1016/j.eswa.2024.124678 · Cited by 357
Fully Convolutional Cross-Scale-Flows for Image-based Defect Detection
Rudolph, M., Wehrbein, T., Rosenhahn, B., & Wandt, B. (2022) · 2022 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV) · doi:10.1109/wacv51458.2022.00189 · Cited by 348
Building Auto-Encoder Intrusion Detection System based on random forest feature selection
Li, X., Chen, W., Zhang, Q., & Wu, L. (2020) · Computers & Security · doi:10.1016/j.cose.2020.101851 · Cited by 337
Generative Adversarial Active Learning for Unsupervised Outlier Detection
Liu, Y., Li, Z., Zhou, C., Jiang, Y., Sun, J., Wang, M., & He, X. (2019) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2019.2905606 · Cited by 335
Self-citationA comprehensive review on deep learning-based methods for video anomaly detection
Nayak, R., Pati, U. C., & Das, S. K. (2021) · Image and Vision Computing · doi:10.1016/j.imavis.2020.104078 · Cited by 324
Anomaly-Based Intrusion Detection From Network Flow Features Using Variational Autoencoder
Zavrak, S., & Iskefiyeli, M. (2020) · IEEE Access · doi:10.1109/access.2020.3001350 · Cited by 322
Diffusion Models for Medical Anomaly Detection
Wolleb, J., Bieder, F., Sandkühler, R., & Cattin, P. C. (2022) · Lecture Notes in Computer Science · doi:10.1007/978-3-031-16452-1_4 · Cited by 322
Conditional Gaussian Distribution Learning for Open Set Recognition
Sun, X., Yang, Z., Zhang, C., Ling, K.-V., & Peng, G. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.01349 · Cited by 312
Unsupervised Deep Anomaly Detection for Multi-Sensor Time-Series Signals
Zhang, Y., Chen, Y., Wang, J., & Pan, Z. (2021) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2021.3102110 · Cited by 312
Towards Visually Explaining Variational Autoencoders
Liu, W., Li, R., Zheng, M., Karanam, S., Wu, Z., Bhanu, B., Radke, R. J., & Camps, O. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00867 · Cited by 294
Asymmetric Student-Teacher Networks for Industrial Anomaly Detection
Rudolph, M., Wehrbein, T., Rosenhahn, B., & Wandt, B. (2023) · 2023 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV) · doi:10.1109/wacv56688.2023.00262 · Cited by 280
Outlier Detection for Time Series with Recurrent Autoencoder Ensembles
Kieu, T., Yang, B., Guo, C., & Jensen, C. S. (2019) · Proceedings of the Twenty-Eighth International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2019/378 · Cited by 272
CANet: An Unsupervised Intrusion Detection System for High Dimensional CAN Bus Data
Hanselmann, M., Strauss, T., Dormann, K., & Ulmer, H. (2020) · IEEE Access · doi:10.1109/access.2020.2982544 · Cited by 268
A quantitative uncertainty metric controls error in neural network-driven chemical discovery
Janet, J. P., Duan, C., Yang, T., Nandy, A., & Kulik, H. J. (2019) · Chemical Science · doi:10.1039/c9sc02298h · Cited by 243
Hyperspectral anomaly detection with robust graph autoencoders
Fan, G., Ma, Y., Mei, X., Fan, F., Huang, J., & Ma, J. (2022) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2021.3097097 · Cited by 212
A survey of swarm and evolutionary computing approaches for deep learning
Darwish, A., Hassanien, A. E., & Das, S. (2020) · Artificial Intelligence Review · doi:10.1007/s10462-019-09719-2 · Cited by 200
Catching Both Gray and Black Swans: Open-set Supervised Anomaly Detection
Ding, C., Pang, G., & Shen, C. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.00724 · Cited by 197
Explainable Deep One-Class Classification
Liznerski, P., Ruff, L., Vandermeulen, R. A., Franks, B. J., Kloft, M., & Müller, K.-R. (2020) · arXiv · doi:10.48550/arxiv.2007.01760 · Cited by 185
Encoding Structure-Texture Relation with P-Net for Anomaly Detection in Retinal Images
Zhou, K., Xiao, Y., Yang, J., Cheng, J., Liu, W., Luo, W., Gu, Z., Liu, J., & Gao, S. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58565-5_22 · Cited by 146
Digital Twin-Based Cyber-Attack Detection Framework for Cyber-Physical Manufacturing Systems
Balta, E. C., Pease, M., Moyne, J., Barton, K., & Tilbury, D. M. (2024) · IEEE Transactions on Automation Science and Engineering · doi:10.1109/tase.2023.3243147 · Cited by 125
DeepAID: Interpreting and Improving Deep Learning-based Anomaly Detection in Security Applications
Han, D., Wang, Z., Chen, W., Zhong, Y., Wang, S., Zhang, H., Yang, J., Shi, X., & Yin, X. (2021) · Proceedings of the 2021 ACM SIGSAC Conference on Computer and Communications Security · doi:10.1145/3460120.3484589 · Cited by 121
Salehi, M., Mirzaei, H., Hendrycks, D., Li, Y., Rohban, M. H., & Sabokrou, M. (2021) · arXiv · doi:10.48550/arxiv.2110.14051 · Cited by 118
Collin, A.-S., & De Vleeschouwer, C. (2021) · 2020 25th International Conference on Pattern Recognition (ICPR) · doi:10.1109/icpr48806.2021.9412842 · Cited by 106
Deep Learning for Anomaly Detection
Wang, R., Nie, K., Wang, T., Yang, Y., & Long, B. (2020) · Proceedings of the 13th International Conference on Web Search and Data Mining · doi:10.1145/3336191.3371876 · Cited by 100
Notice of Removal: Multiresolution Knowledge Distillation for Anomaly Detection
Salehi, M., Sadjadi, N., Baselizadeh, S., Rohban, M. H., & Rabiee, H. R. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.01466 · Cited by 97
Deep Graph-level Anomaly Detection by Glocal Knowledge Distillation
Ma, R., Pang, G., Chen, L., & van den Hengel, A. (2022) · Proceedings of the Fifteenth ACM International Conference on Web Search and Data Mining · doi:10.1145/3488560.3498473 · Cited by 86
Deep Video Anomaly Detection: Opportunities and Challenges
Ren, J., Xia, F., Liu, Y., & Lee, I. (2021) · 2021 International Conference on Data Mining Workshops (ICDMW) · doi:10.1109/icdmw53433.2021.00125 · Cited by 84
Anomaly-Based Insider Threat Detection Using Deep Autoencoders
Liu, L., De Vel, O., Chen, C., Zhang, J., & Xiang, Y. (2018) · 2018 IEEE International Conference on Data Mining Workshops (ICDMW) · doi:10.1109/icdmw.2018.00014 · Cited by 79
An Autocorrelation-based LSTM-Autoencoder for Anomaly Detection on Time-Series Data
Homayouni, H., Ghosh, S., Ray, I., Gondalia, S., Duggan, J., & Kahn, M. G. (2020) · 2020 IEEE International Conference on Big Data (Big Data) · doi:10.1109/bigdata50022.2020.9378192 · Cited by 66
“The reconstruction error (RE) [33] for this network is:”
BackgroundLSTM-Markov based efficient anomaly detection algorithm for IoT environment
V., S., & A., S. (2023) · Applied Soft Computing · doi:10.1016/j.asoc.2023.110054 · Cited by 59
Modeling Quality of IoT Experience in Autonomous Vehicles
Minovski, D., Ahlund, C., & Mitra, K. (2020) · IEEE Internet of Things Journal · doi:10.1109/jiot.2020.2975418 · Cited by 59
“Unsupervised deep learning autoen-coders are proven to be an effective method by first training a model to reconstruct normal data and subsequently identify anomalies as samples with high reconstruction errors [73].”
MethodChen, H., Chen, P., & Yu, G. (2020) · IEEE Access · doi:10.1109/access.2020.2977464 · Cited by 36
Toward Explainable Deep Anomaly Detection
Pang, G., & Aggarwal, C. (2021) · Proceedings of the 27th ACM SIGKDD Conference on Knowledge Discovery & Data Mining · doi:10.1145/3447548.3470794 · Cited by 23
DeepGuard: Deep Generative User-behavior Analytics for Ransomware Detection
Ganfure, G. O., Wu, C.-F., Chang, Y.-H., & Shih, W.-K. (2020) · 2020 IEEE International Conference on Intelligence and Security Informatics (ISI) · doi:10.1109/isi49825.2020.9280508 · Cited by 18
Anomaly Detection Based on Selection and Weighting in Latent Space
Liao, Y., Bartler, A., & Yang, B. (2021) · 2021 IEEE 17th International Conference on Automation Science and Engineering (CASE) · doi:10.1109/case49439.2021.9551267 · Cited by 17
DT4I4-Secure: Digital Twin Framework for Industry 4.0 Systems Security
Lin, Y.-Z., Shao, S., Rahman, M. H., Shafae, M., & Satam, P. (2023) · 2023 IEEE 14th Annual Ubiquitous Computing, Electronics & Mobile Communication Conference (UEMCON) · doi:10.1109/uemcon59035.2023.10316090 · Cited by 14
Image Anomaly Detection with Capsule Networks and Imbalanced Datasets
Piciarelli, C., Mishra, P., & Foresti, G. L. (2019) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-30642-7_23 · Cited by 10
RAAD: Reinforced Adversarial Anomaly Detector
Woo, S. S., Yoon, D., Gim, Y., & Park, E. (2024) · Proceedings of the 39th ACM/SIGAPP Symposium on Applied Computing · doi:10.1145/3605098.3635920 · Cited by 7
Metadata
- Authors
- Zhou, C., & Paffenroth, R. C.
- Venue
- Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining
- Publisher
- ACM
- Published
- 2017-08-04
- Pages
- 665-674
- OpenAlex
- W2743138268
- Cited by
- 1,436
- References
- 22
- FWCI
- 40.01
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.