Deep Structured Energy Based Models for Anomaly Detection
Open accessAbstract
In this paper, we attack the anomaly detection problem by directly modeling the data distribution with deep architectures. We propose deep structured energy based models (DSEBMs), where the energy function is the output of a deterministic deep neural network with structure. We develop novel model architectures to integrate EBMs with different types of data such as static data, sequential data, and spatial data, and apply appropriate model architectures to adapt to the data structure. Our training algorithm is built upon the recent development of score matching \cite{sm}, which connects an EBM with a regularized autoencoder, eliminating the need for complicated sampling method. Statistically sound decision criterion can be derived for anomaly detection purpose from the perspective of the energy landscape of the data distribution. We investigate two decision criteria for performing anomaly detection: the energy score and the reconstruction error. Extensive empirical studies on benchmark tasks demonstrate that our proposed model consistently matches or outperforms all the competing methods.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
PatchCore-100% with IVFPQ has inference times still higher than PatchCore-1%.
“We find a performance drop, especially for image-level anomaly detection, while inference times are still higher than PatchCore -1% .”
From Towards Total Recall in Industrial Anomaly Detection (2022) · cites this paper as [27]
Even with performance reduction, approximate nearest neighbour search on PatchCore-100% still outperforms other methods.
“Though even with performance reduction, approximate nearest neighbour search on PatchCore -100% still outperforms other methods.”
From Towards Total Recall in Industrial Anomaly Detection (2022) · cites this paper as [27]
PatchCore-100% with approximate nearest neighbour search (IVFPQ) shows a performance drop, especially for image-level anomaly detection.
“We find a performance drop, especially for image-level anomaly detection, while inference times are still higher than PatchCore -1% .”
From Towards Total Recall in Industrial Anomaly Detection (2022) · cites this paper as [27]
Cites
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805 · see citing works
UCI Machine Learning Repository
Asuncion, A. (2007) · Medical Entomology and Zoology · Cited by 24,190 · see citing works
Learning Multiple Layers of Features from Tiny Images
Krizhevsky, A. (2024) · doi:10.57702/zp44cu3g · Cited by 23,890 · see citing works
Chandola, V., Banerjee, A., & Kumar, V. (2009) · ACM Computing Surveys · doi:10.1145/1541880.1541882 · Cited by 11,687 · see citing works
On Estimation of a Probability Density Function and Mode
Parzen, E. (1962) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177704472 · Cited by 10,715 · see citing works
Learning Deep Architectures for AI
Bengio, Y. (2009) · now publishers, Inc. eBooks · doi:10.1561/9781601982957 · Cited by 5,037 · see citing works
(2010) · Journal of Machine Learning Research · doi:10.5555/1756006.1953039 · Cited by 4,051 · see citing works
A Practical Guide to Training Restricted Boltzmann Machines
Hinton, G. E. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-35289-8_32 · Cited by 2,852 · see citing works
Lee, H., Grosse, R., Ranganath, R., & Ng, A. Y. (2009) · Proceedings of the 26th Annual International Conference on Machine Learning · doi:10.1145/1553374.1553453 · Cited by 2,412 · see citing works
Fei-Fei, L., Fergus, R., & Perona, P. (2007) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2005.09.012 · Cited by 2,359 · see citing works
Contractive Auto-Encoders: Explicit Invariance During Feature Extraction
Rifai, S., Vincent, P., Muller, X., Glorot, X., & Bengio, Y. (2011) · Cited by 1,189 · see citing works
A Connection Between Score Matching and Denoising Autoencoders
Vincent, P. (2011) · Neural Computation · doi:10.1162/neco_a_00142 · Cited by 1,011 · see citing works
A survey on unsupervised outlier detection in high‐dimensional numerical data
Zimek, A., Schubert, E., & Kriegel, H. (2012) · Statistical Analysis and Data Mining The ASA Data Science Journal · doi:10.1002/sam.11161 · Cited by 864 · cited 2× · see citing works
“A variety of methods can be found in the survey (Zimek et al., 2012).”
BackgroundMethodA Tutorial on Energy-Based Learning
LeCun, Y., Chopra, S., Hadsell, R. T., Ranzato, A., & Huang, F. J. (2006) · Cited by 812 · see citing works
Estimation of Non-Normalized Statistical Models by Score Matching
Hyvärinen, A. (2005) · doi:10.5555/1046920.1088696 · Cited by 756 · see citing works
Boulanger-Lewandowski, N., Bengio, Y., & Vincent, P. (2012) · arXiv (Cornell University) · doi:10.48550/arxiv.1206.6392 · Cited by 484 · see citing works
CUAVE: A new audio-visual database for multimodal human-computer interface research
Patterson, E. K., Gurbuz, S., TÜFEKCİ, Z., & Gowdy, J. N. (2002) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2002.5745028 · Cited by 296 · see citing works
Robust kernel density estimation
Kim, J., & Scott, C. D. (2012) · Journal of Machine Learning Research · doi:10.5555/2503308.2503323 · Cited by 286 · see citing works
A comparative study of RNN for outlier detection in data mining
Williams, G., Baxter, R. A., He, H., Hawkins, S., & Gu, L. (2003) · Proceedings · doi:10.1109/icdm.2002.1184035 · Cited by 281 · see citing works
Ngiam, J., Chen, Z., Koh, P. W., & Ng, A. Y. (2011) · Cited by 137 · see citing works
Unsupervised One-Class Learning for Automatic Outlier Removal
Liu, W., Hua, G., & Smith, J. R. (2014) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2014.483 · Cited by 104 · see citing works
On Autoencoders and Score Matching for Energy Based Models
Swersky, K., Ranzato, M., Buchman, D., de Freitas, N., & Marlin, B. M. (2011) · Cited by 76 · see citing works
Regularized estimation of image statistics by Score Matching
Kingma, D. P., & LeCun, Y. (2010) · neural information processing systems · Cited by 52 · see citing works
Hyunha, N. A. M., & Sugiyama, M. (2015) · IEICE Transactions on Information and Systems · doi:10.1587/transinf.2014edp7335 · Cited by 22 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Gong, D., Liu, L., Le, V., Saha, B., Mansour, M. R., Venkatesh, S., & Van Den Hengel, A. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00179 · Cited by 1,930 · see citing works
Towards Total Recall in Industrial Anomaly Detection
Roth, K., Pemula, L., Zepeda, J., Scholkopf, B., Brox, T., & Gehler, P. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01392 · Cited by 1,810 · see citing works
Deep Learning for Anomaly Detection: A Survey
Chalapathy, R., & Chawla, S. (2019) · arXiv · doi:10.48550/arxiv.1901.03407 · Cited by 1,240 · see citing works
A Unifying Review of Deep and Shallow Anomaly Detection
Ruff, L., Kauffmann, J., Vandermeulen, R. A., Montavon, G., Samek, W., Kloft, M., Dietterich, T. G., & Muller, K.-R. (2021) · Proceedings of the IEEE · doi:10.1109/jproc.2021.3052449 · Cited by 1,080 · see citing works
CutPaste: Self-Supervised Learning for Anomaly Detection and Localization
Li, C.-L., Sohn, K., Yoon, J., & Pfister, T. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00954 · Cited by 1,107 · see citing works
Learning Memory-Guided Normality for Anomaly Detection
Park, H., Noh, J., & Ham, B. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.01438 · Cited by 998 · see citing works
Generalized Out-of-Distribution Detection: A Survey
Yang, J., Zhou, K., Li, Y., & Liu, Z. (2024) · International Journal of Computer Vision · doi:10.1007/s11263-024-02117-4 · Cited by 884 · see citing works
Deep Model Based Domain Adaptation for Fault Diagnosis
Lu, W., Liang, B., Cheng, Y., Meng, D., Yang, J. J., & Zhang, T. (2016) · IEEE Transactions on Industrial Electronics · doi:10.1109/tie.2016.2627020 · Cited by 768 · see citing works
Self-citationEfficient GAN-Based Anomaly DetectionPreprint
Zenati, H., Foo, C.-S., Lecouat, B., Manek, G., & Chandrasekhar, V. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1802.06222 · Cited by 517 · see citing works
Same Same But DifferNet: Semi-Supervised Defect Detection with Normalizing Flows
Rudolph, M., Wandt, B., & Rosenhahn, B. (2021) · 2021 IEEE Winter Conference on Applications of Computer Vision (WACV) · doi:10.1109/wacv48630.2021.00195 · Cited by 489 · see citing works
Deep Anomaly Detection Using Geometric TransformationsPreprint
Golan, I., & El‐Yaniv, R. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1805.10917 · Cited by 479 · see citing works
Adversarially Learned Anomaly Detection
Zenati, H., Romain, M., Foo, C.-S., Lecouat, B., & Chandrasekhar, V. (2018) · Proceedings · doi:10.1109/icdm.2018.00088 · Cited by 450 · see citing works
Anomaly Detection in Automobile Control Network Data with Long Short-Term Memory Networks
Taylor, A., Leblanc, S. P., & Japkowicz, N. (2016) · IEEE International Conference on Data Science and Advanced Analytics (DSAA) · doi:10.1109/dsaa.2016.20 · Cited by 421 · see citing works
Deep Semi-Supervised Anomaly Detection
Ruff, L., Vandermeulen, R. A., Görnitz, N., Binder, A., Müller, E., Müller, K.-R., & Kloft, M. (2019) · arXiv · doi:10.48550/arxiv.1906.02694 · Cited by 388 · see citing works
Anomaly Detection for a Water Treatment System Using Unsupervised Machine Learning
Inoue, J., Yamagata, Y., Chen, Y., POSKITT, C. M., & Sun, J. (2017) · IEEE ... International Conference on Data Mining workshops · doi:10.1109/icdmw.2017.149 · Cited by 372 · see citing works
Fully Convolutional Cross-Scale-Flows for Image-based Defect Detection
Rudolph, M., Wehrbein, T., Rosenhahn, B., & Wandt, B. (2022) · 2022 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV) · doi:10.1109/wacv51458.2022.00189 · Cited by 348 · see citing works
CSI: Novelty Detection via Contrastive Learning on Distributionally Shifted Instances
Tack, J., Mo, S., Jeong, J., & Shin, J. (2020) · arXiv · doi:10.48550/arxiv.2007.08176 · Cited by 351 · see citing works
Auto-Encoders in Deep Learning—A Review with New Perspectives
Chen, S., & Guo, W. (2023) · Mathematics · doi:10.3390/math11081777 · Cited by 341 · see citing works
Asymmetric Student-Teacher Networks for Industrial Anomaly Detection
Rudolph, M., Wehrbein, T., Rosenhahn, B., & Wandt, B. (2023) · 2023 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV) · doi:10.1109/wacv56688.2023.00262 · Cited by 280 · see citing works
Early Fault Detection Approach With Deep Architectures
Lu, W., Li, Y., Cheng, Y., Meng, D., Liang, B., & Zhou, P. (2018) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2018.2800978 · Cited by 199 · see citing works
Self-citationLearning Semantic Context from Normal Samples for Unsupervised Anomaly Detection
Yan, X., Zhang, H., Xu, X., Hu, X., & Heng, P. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i4.16420 · Cited by 190 · see citing works
Attribute Restoration Framework for Anomaly Detection
Ye, F., Huang, C., Cao, J., Li, M., Zhang, Y., & Lu, C. (2020) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2020.3046884 · Cited by 203 · see citing works
Learning Sparse Representation With Variational Auto-Encoder for Anomaly Detection
Sun, J., Wang, X., Xiong, N. N., & Shao, J. (2018) · IEEE Access · doi:10.1109/access.2018.2848210 · Cited by 184 · see citing works
Collaborative Intrusion Detection for VANETs: A Deep Learning-Based Distributed SDN Approach
Shu, J., Zhou, L., Zhang, W., Du, X., & Guizani, M. (2020) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2020.3027390 · Cited by 183 · see citing works
Recent Advances in Anomaly Detection Methods Applied to Aviation
Basora, L., Olivé, X., & Dubot, T. (2019) · Aerospace · doi:10.3390/aerospace6110117 · Cited by 179 · see citing works
Domain Adaptive Transfer Learning for Fault Diagnosis
Wang, Q., Michau, G., & Fink, O. (2019) · Prognostics and System Health Management Conference · doi:10.1109/phm-paris.2019.00054 · Cited by 166 · see citing works
Robust, Deep and Inductive Anomaly Detection
Chalapathy, R., Menon, A. K., & Chawla, S. (2017) · Lecture notes in computer science · doi:10.1007/978-3-319-71249-9_3 · Cited by 167 · see citing works
On the Effectiveness of Image Rotation for Open Set Domain Adaptation
Bucci, S., Loghmani, M. R., & Tommasi, T. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58517-4_25 · Cited by 164 · see citing works
Handling imbalanced medical image data: A deep-learning-based one-class classification approach
Gao, L., Zhang, L., Liu, C., & Wu, S. (2020) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2020.101935 · Cited by 165 · see citing works
A Survey on Unsupervised Anomaly Detection Algorithms for Industrial Images
Cui, Y., Liu, Z., & Lian, S. (2023) · IEEE Access · doi:10.1109/access.2023.3282993 · Cited by 164 · see citing works
Anomaly Detection in Medical Imaging With Deep Perceptual Autoencoders
Shvetsova, N., Bakker, B., Fedulova, I., Schulz, H., & Dylov, D. V. (2021) · IEEE Access · doi:10.1109/access.2021.3107163 · Cited by 174 · see citing works
A Spatiotemporal Deep Learning Approach for Unsupervised Anomaly Detection in Cloud Systems
He, Z., Chen, P., Li, X., Wang, Y., Yu, G., Chen, C., Li, X., & Zheng, Z. (2020) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2020.3027736 · Cited by 151 · see citing works
Applications of Generative Adversarial Networks in Anomaly Detection: A Systematic Literature Review
Sabuhi, M., Zhou, M., Bezemer, C., & Musı́lek, P. (2021) · IEEE Access · doi:10.1109/access.2021.3131949 · Cited by 148 · see citing works
Robust Anomaly Detection in Images Using Adversarial Autoencoders
Beggel, L., Pfeiffer, M., & Bischl, B. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-46150-8_13 · Cited by 138 · see citing works
Toward Explainable Deep Neural Network Based Anomaly Detection
Amarasinghe, K., Kenney, K., & Manic, M. (2018) · Conference on Human System Interactions · doi:10.1109/hsi.2018.8430788 · Cited by 133 · see citing works
Adaptive Memory Networks With Self-Supervised Learning for Unsupervised Anomaly Detection
Zhang, Y., Wang, J., Chen, Y., Yu, H., & Qin, T. (2022) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2021.3139916 · Cited by 136 · see citing works
DOPING: Generative Data Augmentation for Unsupervised Anomaly Detection with GAN
Lim, S. K., Loo, Y., Tran, N.-T., Cheung, N. M., Roig, G., & Elovici, Y. (2018) · Proceedings · doi:10.1109/icdm.2018.00146 · Cited by 127 · see citing works
Video Event Restoration Based on Keyframes for Video Anomaly Detection
Yang, Z., Liu, J., Wu, Z., Wu, P., & Liu, X. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.01402 · Cited by 125 · see citing works
Learning and Evaluating Representations for Deep One-class ClassificationPreprint
Sohn, K., Li, C., Yoon, J., Jin, M., & Pfister, T. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2011.02578 · Cited by 138 · see citing works
Unsupervised Sequential Outlier Detection With Deep Architectures
Lu, W., Cheng, Y., Xiao, C., Chang, S., Huang, S., Liang, B., & Huang, T. S. (2017) · IEEE Transactions on Image Processing · doi:10.1109/tip.2017.2713048 · Cited by 121 · see citing works
Self-citationA Comparative Study of Time Series Anomaly Detection Models for Industrial Control Systems
Kim, B., Alawami, M. A., Kim, E., Oh, S., Park, J., & Kim, H. (2023) · Sensors · doi:10.3390/s23031310 · Cited by 126 · see citing works
A survey of machine learning methods applied to anomaly detection on drinking-water quality data
Dogo, E. M., Nwulu, N. I., Twala, B., & Aigbavboa, C. O. (2019) · Urban Water Journal · doi:10.1080/1573062x.2019.1637002 · Cited by 113 · see citing works
Text Prompt with Normality Guidance for Weakly Supervised Video Anomaly Detection
Yang, Z., Liu, J., & Wu, P. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01788 · Cited by 114 · see citing works
A Hierarchical Transformation-Discriminating Generative Model for Few Shot Anomaly Detection
Sheynin, S., Benaim, S., & Wolf, L. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00838 · Cited by 106 · see citing works
Lee, J., Lee, Y. C., & Kim, J. T. (2020) · Journal of Manufacturing Systems · doi:10.1016/j.jmsy.2020.10.013 · Cited by 106 · see citing works
DROCC: Deep Robust One-Class ClassificationPreprint
Goyal, S., Raghunathan, A., Jain, M., Simhadri, H. V., & Jain, P. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2002.12718 · Cited by 108 · see citing works
Fence GAN: Towards Better Anomaly Detection
Ngo, P. C., Winarto, A. A., Kou, C. K. L., Park, S., Akram, F., & Lee, H. K. (2019) · IEEE International Conference on Tools with Artificial Intelligence (ICTAI) · doi:10.1109/ictai.2019.00028 · Cited by 103 · see citing works
Towards explaining anomalies: A deep Taylor decomposition of one-class models
Kauffmann, J., Müller, K., & Montavon, G. (2020) · Pattern Recognition · doi:10.1016/j.patcog.2020.107198 · Cited by 101 · see citing works
Deep Learning for Anomaly Detection
Wang, R., Nie, K., Wang, T., Yang, Y., & Long, B. (2020) · Proceedings of the 13th International Conference on Web Search and Data Mining · doi:10.1145/3336191.3371876 · Cited by 100 · see citing works
Notice of Removal: Multiresolution Knowledge Distillation for Anomaly Detection
Salehi, M., Sadjadi, N., Baselizadeh, S., Rohban, M. H., & Rabiee, H. R. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.01466 · Cited by 97 · see citing works
DSDNet: Deep Structured Self-driving Network
Zeng, W., Wang, S., Liao, R., Chen, Y., Yang, B., & Urtasun, R. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58589-1_10 · Cited by 96 · see citing works
Online anomaly detection with concept drift adaptation using recurrent neural networks
Saurav, S., Malhotra, P., Tv, V., Gugulothu, N., Vig, L., Agarwal, P., & Shroff, G. M. (2018) · Joint International Conference on Data Science & Management of Data (CODS-COMAD) · doi:10.1145/3152494.3152501 · Cited by 94 · see citing works
Self-Supervision-Augmented Deep Autoencoder for Unsupervised Visual Anomaly Detection
Huang, C., Yang, Z., Wen, J., Xu, Y., Jiang, Q., Yang, J., & Wang, Y. (2021) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2021.3127716 · Cited by 94 · see citing works
Learning Unsupervised Metaformer for Anomaly Detection
Wu, J.-C., Chen, D.-J., Fuh, C.-S., & Liu, T.-L. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00433 · Cited by 91 · see citing works
Anomaly Detection with Machine Learning Algorithms and Big Data in Electricity Consumption
Oprea, S., Bârã, A., Puican, F. C., & Radu, I. C. (2021) · Sustainability · doi:10.3390/su131910963 · Cited by 87 · see citing works
Deep anomaly detection with self-supervised learning and adversarial training
Zhang, X., Mu, J., Zhang, X., Liu, H., Zong, L., & Li, Y. (2021) · Pattern Recognition · doi:10.1016/j.patcog.2021.108234 · Cited by 81 · see citing works
Detection of Anomalies in Large Scale Accounting Data using Deep Autoencoder NetworksPreprint
Schreyer, M., Sattarov, T., Borth, D., Dengel, A., & Reimer, B. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1709.05254 · Cited by 126 · see citing works
Deep Residual Flow for Out of Distribution Detection
Zisselman, E., & Tamar, A. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.01401 · Cited by 79 · see citing works
GAN Ensemble for Anomaly Detection
Xu, H., Chen, X., & Liu, L. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i5.16530 · Cited by 79 · see citing works
Deep Unsupervised Anomaly Detection
Li, T., Wang, Z., Liu, S., & Lin, W.-Y. (2021) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv48630.2021.00368 · Cited by 77 · see citing works
An Encoding Technique for CNN-based Network Anomaly Detection
Kim, T., Suh, S. C., Kim, H., Kim, J., & Kim, J. (2018) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata.2018.8622568 · Cited by 76 · see citing works
Recent endeavors in machine learning-powered intrusion detection systems for the Internet of Things
Manivannan, D. (2024) · Journal of Network and Computer Applications · doi:10.1016/j.jnca.2024.103925 · Cited by 78 · see citing works
Cognitive Memory-Guided AutoEncoder for Effective Intrusion Detection in Internet of Things
Lu, H., Wang, T., Xu, X., & Wang, T. (2021) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2021.3102637 · Cited by 73 · see citing works
Systematization of Corner Cases for Visual Perception in Automated Driving
Breitenstein, J., Termöhlen, J.-A., Lipinski, D., & Fingscheidt, T. (2020) · IEEE Intelligent Vehicles Symposium · doi:10.1109/iv47402.2020.9304789 · Cited by 71 · see citing works
Outlier Detection in Wearable Sensor Data for Human Activity Recognition (HAR) Based on DRNNs
Muñoz-Organero, M. (2019) · IEEE Access · doi:10.1109/access.2019.2921096 · Cited by 70 · see citing works
Uncertainty-Aware Deep Classifiers Using Generative Models
Şensoy, M., Kaplan, L., Cerutti, F., & Saleki, M. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i04.6015 · Cited by 65 · see citing works
Visual Anomaly Detection via Partition Memory Bank Module and Error Estimation
Xing, P., & Li, Z. (2023) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2023.3237562 · Cited by 65 · see citing works
Rethinking Out-of-distribution (OOD) Detection: Masked Image Modeling is All You Need
Li, J., Chen, P., He, Z., Yu, S., Liu, S., & Jia, J. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.01114 · Cited by 63 · see citing works
An Empirical Evaluation of Deep Learning for Network Anomaly Detection
Malaiya, R. K., Kwon, D., Kim, J., Suh, S. C., Kim, H., & Kim, I. (2018) · 2018 International Conference on Computing, Networking and Communications (ICNC) · doi:10.1109/iccnc.2018.8390278 · Cited by 62 · see citing works
MStream: Fast Anomaly Detection in Multi-Aspect Streams
Bhatia, S., Jain, A., Li, P., Kumar, R., & Hooi, B. (2021) · International World Wide Web Conference (WWW) · doi:10.1145/3442381.3450023 · Cited by 63 · see citing works
Flow Contrastive Estimation of Energy-Based Models
Gao, R., Nijkamp, E., Kingma, D. P., Xu, Z. X., Dai, A. M., & Wu, Y. N. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.00754 · Cited by 65 · see citing works
Learning representations of multivariate time series with missing data
Bianchi, F. M., Livi, L., Mikalsen, K. Ø., Kampffmeyer, M., & Jenssen, R. (2019) · Pattern Recognition · doi:10.1016/j.patcog.2019.106973 · Cited by 70 · see citing works
ARAE: Adversarially robust training of autoencoders improves novelty detection
Salehi, M., Arya, A., Pajoum, B., Otoofi, M., Shaeiri, A., Rohban, M. H., & Rabiee, H. R. (2021) · Neural Networks · doi:10.1016/j.neunet.2021.09.014 · Cited by 61 · see citing works
Maximum Entropy Generators for Energy-Based ModelsPreprint
Kumar, R., Ozair, S., Goyal, A., Courville, A. C., & Bengio, Y. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1901.08508 · Cited by 72 · see citing works
Consensus Regularized Multi-View Outlier Detection
Zhao, H., Liu, H., Ding, Z., & Fu, Y. (2017) · IEEE Transactions on Image Processing · doi:10.1109/tip.2017.2754942 · Cited by 58 · see citing works
ARCADE: Adversarially Regularized Convolutional Autoencoder for Network Anomaly Detection
Lunardi, W. T., Lopez, M. A., & Giacalone, J. (2022) · IEEE Transactions on Network and Service Management · doi:10.1109/tnsm.2022.3229706 · Cited by 60 · see citing works
Chen, Y., Ashizawa, N., Yeo, C. K., Yanai, N., & Yean, S. (2021) · Knowledge-Based Systems · doi:10.1016/j.knosys.2021.107086 · Cited by 56 · see citing works
Machine learning in NextG networks via generative adversarial networks
Ayanoglu, E., Davaslioglu, K., & Sagduyu, Y. E. (2022) · IEEE Transactions on Cognitive Communications and Networking · doi:10.1109/tccn.2022.3153004 · Cited by 55 · see citing works
Learning Robust Deep State Space for Unsupervised Anomaly Detection in Contaminated Time-Series
Li, L., Yan, J., Wen, Q., Jin, Y., & Yang, X. (2022) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2022.3171562 · Cited by 55 · see citing works
Sample Efficient Home Power Anomaly Detection in Real Time Using Semi-Supervised Learning
Wang, X., Yang, I., & Ahn, S. (2019) · IEEE Access · doi:10.1109/access.2019.2943667 · Cited by 55 · see citing works
Khan, W., Haroon, M. A., Khan, A. N., Hasan, M. K., Khan, A., Mokhtar, U. A., & Islam, S. (2022) · IEEE Access · doi:10.1109/access.2022.3201332 · Cited by 53 · see citing works
Abnormal Traffic Detection: Traffic Feature Extraction and DAE-GAN With Efficient Data Augmentation
Li, Z., Chen, S., Dai, H., Xu, D., Chu, C., & Xiao, B. (2022) · IEEE Transactions on Reliability · doi:10.1109/tr.2022.3204349 · Cited by 53 · see citing works
Anomaly Detection in Aerial Videos With Transformers
Jin, P., Mou, L., Xia, G.-S., & Zhu, X. X. (2022) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2022.3198130 · Cited by 52 · see citing works
Modified Autoencoder Training and Scoring for Robust Unsupervised Anomaly Detection in Deep Learning
Merrill, N., & Eskandarian, A. (2020) · IEEE Access · doi:10.1109/access.2020.2997327 · Cited by 49 · see citing works
Attribute Restoration Framework for Anomaly DetectionPreprint
Huang, C., Ye, F., Cao, J., Li, M., Zhang, Y., & Lu, C. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1911.10676 · Cited by 49 · see citing works
Adaptive Model Pooling for Online Deep Anomaly Detection from a Complex Evolving Data Stream
Yoon, S., Lee, Y., Lee, J.-G., & Lee, B. S. (2022) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3534678.3539348 · Cited by 49 · see citing works
Deep Dual Support Vector Data description for anomaly detection on attributed networks
Zhang, F., Fan, H., Wang, R., Li, Z., & Liang, T. (2021) · International Journal of Intelligent Systems · doi:10.1002/int.22683 · Cited by 48 · see citing works
Combining Unsupervised Approaches for Near Real-Time Network Traffic Anomaly Detection
Carrera, F., Dentamaro, V., Galantucci, S., Iannacone, A., Impedovo, D., & Pirlo, G. (2022) · Applied Sciences · doi:10.3390/app12031759 · Cited by 47 · see citing works
Positive-Sample-Based Surface Defect Detection Using Memory-Augmented Adversarial Autoencoders
Niu, T., Li, B., Li, W., Qiu, Y., & Niu, S. (2021) · IEEE/ASME Transactions on Mechatronics · doi:10.1109/tmech.2021.3058147 · Cited by 47 · see citing works
Simple and Effective Prevention of Mode Collapse in Deep One-Class Classification
Chong, P., Ruff, L., Kloft, M., & Binder, A. (2020) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn48605.2020.9207209 · Cited by 46 · see citing works
Rethinking Assumptions in Deep Anomaly DetectionPreprint
Ruff, L., Vandermeulen, R. A., Franks, B. J., Müller, K., & Kloft, M. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.00339 · Cited by 62 · see citing works
An Empirical Study on Unsupervised Network Anomaly Detection using Generative Adversarial Networks
Truong-Huu, T., Dheenadhayalan, N., Kundu, P. P., Ramnath, V., Jingyi, L., Teo, S. G., & Kadiyala, S. P. (2020) · doi:10.1145/3385003.3410924 · Cited by 45 · see citing works
A brief introductory review to deep generative models for civil structural health monitoring
Luleci, F., & Çatbaş, F. N. (2023) · AI in Civil Engineering · doi:10.1007/s43503-023-00017-z · Cited by 48 · see citing works
Deep Active Learning for Anomaly Detection
Pimentel, T., Monteiro, M., Veloso, A., & Ziviani, N. (2020) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn48605.2020.9206769 · Cited by 56 · see citing works
End-to-End Learning for Structured Prediction Energy NetworksPreprint
Belanger, D., Yang, B., & McCallum, A. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1703.05667 · Cited by 53 · see citing works
ADTCD: An Adaptive Anomaly Detection Approach Toward Concept Drift in IoT
Xu, L., Xiao, D., Peng, H., Zhao, D., & Li, X. (2023) · IEEE Internet of Things Journal · doi:10.1109/jiot.2023.3265964 · Cited by 44 · see citing works
Anomaly Detection Based on Zero-Shot Outlier Synthesis and Hierarchical Feature Distillation
Rivera, A. R., Khan, A., Bekkouch, I. E. I., & Sheikh, T. S. (2020) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2020.3027667 · Cited by 43 · see citing works
Anomaly Detection: How to Artificially Increase Your F1-Score with a Biased Evaluation Protocol
Fourure, D., Javaid, M. U., Posocco, N., & Tihon, S. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-86514-6_1 · Cited by 50 · see citing works
SALAD: Self-supervised Aggregation Learning for Anomaly Detection on X-Rays
Bozorgtabar, B., Mahapatra, D., Vray, G., & Thiran, J. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-59710-8_46 · Cited by 42 · see citing works
Deep Generative Model Using Unregularized Score for Anomaly Detection With Heterogeneous Complexity
Matsubara, T., Sato, K., Hama, K., Tachibana, R., & Uehara, K. (2020) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2020.3027724 · Cited by 43 · see citing works
- Authors
- Zhai, S., Cheng, Y., Lu, W., & Zhang, Z.
- Affiliations
- Binghamton University (US)
- IBM (United States) (US)
- Tsinghua University (CN)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2016
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1605.07717
- OpenAlex
- W2398119937
- Cited by
- 334
- References
- 24
- Citations by year
- 2025: 9 · 2024: 30 · 2023: 29 · 2022: 44 · 2021: 57 · 2020: 71 · 2019: 48 · 2018: 31 · 2017: 10 · 2016: 5
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Anomaly Detection Techniques and Applications
- Physical Sciences › Computer Science › Artificial Intelligence › Adversarial Robustness in Machine Learning
- Physical Sciences › Computer Science › Computer Networks and Communications › Software System Performance and Reliability
- Keywords
- anomaly detection, energy-based models, score matching, energy landscape, reconstruction error, decision criteria, sequential data, geospatial data, static data
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review