The DOI matches its DataCite record; 50 of the 50 references it cites were found in a registry or an index.
Generative Probabilistic Novelty Detection with Adversarial Autoencoders
Open accessAbstract
Novelty detection is the problem of identifying whether a new data point is considered to be an inlier or an outlier. We assume that training data is available to describe only the inlier distribution. Recent approaches primarily leverage deep encoder-decoder network architectures to compute a reconstruction error that is used to either compute a novelty score or to train a one-class classifier. While we too leverage a novel network of that kind, we take a probabilistic approach and effectively compute how likely is that a sample was generated by the inlier distribution. We achieve this with two main contributions. First, we make the computation of the novelty probability feasible because we linearize the parameterized manifold capturing the underlying structure of the inlier distribution, and show how the probability factorizes and can be computed with respect to local coordinates of the manifold tangent space. Second, we improved the training of the autoencoder network. An extensive set of results show that the approach achieves state-of-the-art results on several benchmark datasets.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Finally, for practical applicability, PatchCore additionally introduces greedy coreset subsampling [1] for nominal feature banks as a key element to both reduce redundancy in the extracted, patch-level memory bank as well as significantly bringing down storage memory and inference time, making PatchCore very attractive for realistic industrial use cases.”
From Towards Total Recall in Industrial Anomaly Detection (2022) · cites this paper as [1]
Citations
Cites
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
ImageNet Large Scale Visual Recognition Challenge
Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., Bernstein, M., et al. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-015-0816-y · Cited by 39,380
Learning representations by back-propagating errors
Rumelhart, D. E., Hinton, G. E., & Williams, R. J. (1986) · Nature · doi:10.1038/323533a0 · Cited by 31,892
Learning Multiple Layers of Features from Tiny Images
Krizhevsky, A. (2024) · doi:10.57702/zp44cu3g · Cited by 23,889
Auto-Encoding Variational Bayes
Kingma, D. P., & Welling, M. (2013) · arXiv · doi:10.48550/arxiv.1312.6114 · Cited by 20,067
(2017) · Cited by 11,625
Fashion-MNIST: a Novel Image Dataset for Benchmarking Machine Learning Algorithms
Xiao, H., Rasul, K., & Vollgraf, R. (2017) · arXiv · doi:10.48550/arxiv.1708.07747 · Cited by 6,108
LOF: identifying density-based local outliers
Breunig, M. M., Kriegel, H.-P., Ng, R. T., & Sander, J. (2000) · ACM SIGMOD Record · doi:10.1145/335191.335388 · Cited by 5,207
What Uncertainties Do We Need in Bayesian Deep Learning for Computer Vision?
Kendall, A., & Gal, Y. (2017) · arXiv · doi:10.48550/arxiv.1703.04977 · Cited by 3,088
BARNETT, V. D., Lewis, T., & Abeles, F. F. (1979) · Physics Today · doi:10.1063/1.2995737 · Cited by 2,834
Conditional Image Generation with PixelCNN DecodersPreprint
van den Oord, A., Kalchbrenner, N., Vinyals, O., Espeholt, L., Graves, A., & Kavukcuoglu, K. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1606.05328 · Cited by 2,032
Pixel Recurrent Neural NetworksPreprint
van den Oord, A., Kalchbrenner, N., & Kavukcuoglu, K. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1601.06759 · Cited by 1,793
Anomaly Detection Using Autoencoders with Nonlinear Dimensionality Reduction
Sakurada, M., & Yairi, T. (2014) · Proceedings of the MLSDA 2014 2nd Workshop on Machine Learning for Sensory Data Analysis · doi:10.1145/2689746.2689747 · Cited by 1,438
Robust Subspace Segmentation by Low-Rank Representation
Liu, G., Lin, Z., & Yu, Y. H. (2010) · Cited by 1,415
Auto-association by multilayer perceptrons and singular value decomposition
Bourlard, H., & Kamp, Y. (1988) · Biological Cybernetics · doi:10.1007/bf00332918 · Cited by 1,391
Columbia Object Image Library (COIL100)
Nayar, S. K. (1996) · Medical Entomology and Zoology · Cited by 1,349
Distance-based outliers: algorithms and applications
Knorr, E. M., Ng, R. T., & Tucakov, V. (2000) · The VLDB Journal The International Journal on Very Large Data Bases · doi:10.1007/s007780050006 · Cited by 1,195
Anomaly Detection and Localization in Crowded Scenes
Li, W., Mahadevan, V., & Vasconcelos, N. M. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2013.111 · Cited by 1,024
Review of Recent Research on Data-Based Process Monitoring
Ge, Z., Song, Z., & Gao, F. (2013) · Industrial & Engineering Chemistry Research · doi:10.1021/ie302069q · Cited by 969
Sparse reconstruction cost for abnormal event detection
Cong, Y., Yuan, J., & Liu, J. (2011) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2011.5995434 · Cited by 819
Autoencoding beyond pixels using a learned similarity metricPreprint
Larsen, A., Sønderby, S. K., Larochelle, H., & Winther, O. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1512.09300 · Cited by 813
Adversarially Learned One-Class Classifier for Novelty Detection
Sabokrou, M., Khalooei, M., Fathy, M., & Adeli, E. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00356 · Cited by 765
One-class classification: taxonomy of study and review of techniques
Khan, S. S., & Madden, M. G. (2014) · The Knowledge Engineering Review · doi:10.1017/s026988891300043x · Cited by 629
Kadurin, A., Nikolenko, S., Khrabrov, K., Aliper, A., & Zhavoronkov, A. (2017) · Molecular Pharmaceutics · doi:10.1021/acs.molpharmaceut.7b00346 · Cited by 587
Salimans, T., Karpathy, A., Chen, X., & Kingma, D. P. (2017) · arXiv · doi:10.48550/arxiv.1701.05517 · Cited by 584
Learning Confidence for Out-of-Distribution Detection in Neural NetworksPreprint
DeVries, T., & Taylor, G. W. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1802.04865 · Cited by 567
Abnormal event detection in videos using generative adversarial nets
Ravanbakhsh, M., Nabi, M., Sangineto, E., Marcenaro, L., Regazzoni, C. S., & Sebe, N. (2017) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2017.8296547 · Cited by 557
Anomaly Detection over Noisy Data Using Learned Probability Distributions
Eskin, E. (2000) · doi:10.7916/d8c53skf · Cited by 483
On-Line Unsupervised Outlier Detection Using Finite Mixtures with Discounting Learning Algorithms
Yamanishi, K., Takeuchi, J., Williams, G., & Milne, P. (2004) · Data Mining and Knowledge Discovery · doi:10.1023/b:dami.0000023676.72185.7c · Cited by 478
Enhancing the reliability of out-of-distribution image detection in neural networks
Liang, S. (2025) · TIB Data Manager · doi:10.57702/uwcm8hhf · Cited by 474
A geometric analysis of subspace clustering with outliers
Soltanolkotabi, M., & Candès, E. J. (2012) · The Annals of Statistics · doi:10.1214/12-aos1034 · Cited by 412
A novelty detection approach to classification
Japkowicz, N., Myers, C. E., & Gluck, M. A. (1995) · Cited by 392
Sabokrou, M., Fayyaz, M., Fathy, M., & Klette, R. (2017) · IEEE Transactions on Image Processing · doi:10.1109/tip.2017.2670780 · Cited by 385
Learning Discriminative Reconstructions for Unsupervised Outlier Removal
Xia, Y., Cao, X., Wen, F., Hua, G., & Sun, J. Z. (2015) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.177 · Cited by 301
Robust kernel density estimation
Kim, J., & Scott, C. D. (2012) · Journal of Machine Learning Research · doi:10.5555/2503308.2503323 · Cited by 286
TurkerGaze: Crowdsourcing Saliency with Webcam based Eye TrackingPreprint
Xu, P., Ehinger, K. A., Zhang, Y., Finkelstein, A., Kulkarni, S. R., & Xiao, J. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1504.06755 · Cited by 251
Outlier detection using k-nearest neighbour graph
Hautamäki, V., Kärkkäinen, I., & Fränti, P. (2004) · Cited by 243
Robust PCA via Outlier PursuitPreprint
Xu, H., Caramanis, C., & Sanghavi, S. (2010) · arXiv (Cornell University) · doi:10.48550/arxiv.1010.4237 · Cited by 238
A baseline for detecting misclassified and out-of-distribution examples in neural networksPreprint
Hendrycks, D. (2025) · arXiv (Cornell University) · doi:10.57702/9gs720u1 · Cited by 236
One-class document classification via Neural Networks
Manevitz, L. M., & Yousef, M. (2006) · Neurocomputing · doi:10.1016/j.neucom.2006.05.013 · Cited by 198
Sabokrou, M., Fathy, M., & Hoseini, M. (2016) · Electronics Letters · doi:10.1049/el.2016.0440 · Cited by 198
Coherence Pursuit: Fast, Simple, and Robust Principal Component Analysis
Rahmani, M., & Atia, G. (2017) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2017.2749215 · Cited by 132
Robust Computation of Linear Models by Convex Relaxation
Lerman, G., McCoy, M. B., Tropp, J. A., & Zhang, T. (2014) · Foundations of Computational Mathematics · doi:10.1007/s10208-014-9221-0 · Cited by 129
Kernel Null Space Methods for Novelty Detection
Bodesheim, P., Freytag, A., Rodner, E., Kemmler, M., & Denzler, J. (2013) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2013.433 · Cited by 125
Outlier Detection Using Random Walks
Moonesinghe, H. D. K., & Tan, P. (2006) · IEEE International Conference on Tools with Artificial Intelligence (ICTAI) · doi:10.1109/ictai.2006.94 · Cited by 83
OutRank: A GRAPH-BASED OUTLIER DETECTION FRAMEWORK USING RANDOM WALK
Moonesinghe, H. D. K., & Tan, P. (2008) · International Journal of Artificial Intelligence Tools · doi:10.1142/s0218213008003753 · Cited by 76
Learning Temporal Regularity in Video SequencesPreprint
Hasan, M., Choi, J., Neumann, J., Roy–Chowdhury, A. K., & Davis, L. S. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1604.04574 · Cited by 66
Incremental Kernel Null Space Discriminant Analysis for Novelty Detection
Liu, J., Lian, Z., Wang, Y., & Xiao, J. (2017) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2017.439 · Cited by 55
Generative adversarial network based novelty detection usingminimized reconstruction error
Wang, H., Li, X., & Zhang, T. (2018) · Frontiers of Information Technology & Electronic Engineering · doi:10.1631/fitee.1700786 · Cited by 31
Cited by
Sorted by citations
Towards Total Recall in Industrial Anomaly Detection
Roth, K., Pemula, L., Zepeda, J., Scholkopf, B., Brox, T., & Gehler, P. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01392 · Cited by 1,810
“Other unsupervised representation learning methods can similarly be utilised, such as via GANs [13], learning to predict predefined geometric transformations [20] or via normalizing flows [42].”
BackgroundMethodInfluentialPaDiM: A Patch Distribution Modeling Framework for Anomaly Detection and Localization
Defard, T., Setkov, A., Loesch, A., & Audigier, R. (2021) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-68799-1_35 · Cited by 1,415
A Unifying Review of Deep and Shallow Anomaly Detection
Ruff, L., Kauffmann, J., Vandermeulen, R. A., Montavon, G., Samek, W., Kloft, M., Dietterich, T. G., & Muller, K.-R. (2021) · Proceedings of the IEEE · doi:10.1109/jproc.2021.3052449 · Cited by 1,184
Generalized Out-of-Distribution Detection: A Survey
Yang, J., Zhou, K., Li, Y., & Liu, Z. (2024) · International Journal of Computer Vision · doi:10.1007/s11263-024-02117-4 · Cited by 884
OCGAN: One-Class Novelty Detection Using GANs With Constrained Latent Representations
Perera, P., Nallapati, R., & Xiang, B. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00301 · Cited by 608
Metadata
- Authors
- Pidhorskyi, S., Almohsen, R., Adjeroh, D. A., & Doretto, G.
- Affiliations
- West Virginia University (US)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2018
- Volume
- 31
- Pages
- 6823-6834
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1807.02588
- OpenAlex
- W2860343088
- Cited by
- 255
- References
- 50
- Citations by year
- 2026: 1 · 2025: 10 · 2024: 34 · 2023: 43 · 2022: 40 · 2021: 70 · 2020: 42 · 2019: 15
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- neural information processing systems
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Anomaly Detection Techniques and Applications
- Physical Sciences › Computer Science › Artificial Intelligence › Adversarial Robustness in Machine Learning
- Physical Sciences › Engineering › Control and Systems Engineering › Fault Detection and Control Systems
- Keywords
- novelty detection, outlier detection, probabilistic generative models, adversarial autoencoder, tangent space, reconstruction error, one-class classification
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
