The DOI matches its DataCite record; 43 of the 45 references it cites were found in a registry or an index.
Sub-Image Anomaly Detection with Deep Pyramid Correspondences
Open accessAbstract
Nearest neighbor (kNN) methods utilizing deep pre-trained features exhibit very strong anomaly detection performance when applied to entire images. A limitation of kNN methods is the lack of segmentation map describing where the anomaly lies inside the image. In this work we present a novel anomaly segmentation approach based on alignment between an anomalous image and a constant number of the similar normal images. Our method, Semantic Pyramid Anomaly Detection (SPADE) uses correspondences based on a multi-resolution feature pyramid. SPADE is shown to achieve state-of-the-art performance on unsupervised anomaly detection and localization while requiring virtually no training time.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Compared to image-level memory approaches in [10], we find matching localization and detection performance with only 5 / 1 nominal shots.”
From Towards Total Recall in Industrial Anomaly Detection (2022) · cites this paper as [10]
In the citing paper
“Due to computational limitations, SPADE requires a preselection stage of feature maps for pixel-level anomaly detection based on a weaker image-level anomaly detection mechanism reliant on full-image, deep feature representations, i.e., global averaging of the last feature map.”
From Towards Total Recall in Industrial Anomaly Detection (2022) · cites this paper as [10]
In the citing paper
“As can be seen, inference time for joint image- and pixel-level anomaly detection of PatchCore -100% (without subsampling) are lower than SPADE [10] but with higher performance.”
From Towards Total Recall in Industrial Anomaly Detection (2022) · cites this paper as [10]
In the citing paper
“As can be seen, inference time for joint image- and pixel-level anomaly detection of PatchCore -100% (without subsampling) are lower than SPADE [10] but with higher performance.”
From Towards Total Recall in Industrial Anomaly Detection (2022) · cites this paper as [10]
In the citing paper
“Empirically and similar to [10] and [14], we found aggregation of multiple feature hierarchies to offer some benefit.”
From Towards Total Recall in Industrial Anomaly Detection (2022) · cites this paper as [10]
In the citing paper
“More global context can also be achieved by moving down the network hierarchy (see e.g. [10, 14]), however at the cost of reduced resolution and heavier ImageNet class bias (§3.1).”
From Towards Total Recall in Industrial Anomaly Detection (2022) · cites this paper as [10]
In the citing paper
“Semantic pyramid anomaly detection (SPADE) [63] is inspired by KNN and utilizes correspondences based on a multi-resolution feature pyramid to obtain pixel-level anomaly segmentation results.”
From Deep Industrial Image Anomaly Detection: A Survey (2024) · cites this paper as [63]
In the citing paper
“PatchCore [68] , SPADE [63] and PaDim [73] conduct the ablation study on 16 normal training samples.”
From Deep Industrial Image Anomaly Detection: A Survey (2024) · cites this paper as [63]
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Image quality assessment: from error visibility to structural similarity
Wang, Z., Bovik, A. C., Sheikh, H. R., & Simoncelli, E. P. (2004) · IEEE Transactions on Image Processing · doi:10.1109/tip.2003.819861 · Cited by 57,892
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 54,325
An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale
Dosovitskiy, A., Beyer, L., Kolesnikov, A., Weissenborn, D., Zhai, X., Unterthiner, T., Dehghani, M., Minderer, M., Heigold, G., Gelly, S., et al. (2020) · arXiv · doi:10.48550/arxiv.2010.11929 · Cited by 47,472
Feature Pyramid Networks for Object Detection
Lin, T.-Y., Dollar, P., Girshick, R., He, K., Hariharan, B., & Belongie, S. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.106 · Cited by 30,939
Grad-CAM: Visual Explanations from Deep Networks via Gradient-Based Localization
Selvaraju, R. R., Cogswell, M., Das, A., Vedantam, R., Parikh, D., & Batra, D. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.74 · Cited by 24,513
Language Models are Few-Shot Learners
Brown, T. B., Mann, B., Ryder, N., Subbiah, M., Kaplan, J., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., Askell, A., et al. (2020) · arXiv · doi:10.48550/arxiv.2005.14165 · Cited by 23,372
GAN（Generative Adversarial Nets）
淳司, 柴. (2017) · Journal of Japan Society for Fuzzy Theory and Intelligent Informatics · doi:10.3156/jsoft.29.5_177_2 · Cited by 20,507
Algorithm AS 136: A K-Means Clustering Algorithm
Hartigan, J. A., & Wong, M. A. (1979) · Applied Statistics · doi:10.2307/2346830 · Cited by 14,523
Chandola, V., Banerjee, A., & Kumar, V. (2009) · ACM Computing Surveys · doi:10.1145/1541880.1541882 · Cited by 11,687
Support Vector Data Description
Tax, D. M. J., & Duin, R. P. W. (2003) · Machine Learning · doi:10.1023/b:mach.0000008084.60811.49 · Cited by 3,612
Automated Flower Classification over a Large Number of Classes
Nilsback, M.-E., & Zisserman, A. (2008) · 2008 Sixth Indian Conference on Computer Vision, Graphics & Image Processing · doi:10.1109/icvgip.2008.47 · Cited by 3,442
Zhang, R., Isola, P., & Efros, A. A. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-46487-9_40 · Cited by 3,417
Self-Attention Generative Adversarial Networks
Zhang, H., Goodfellow, I., Metaxas, D., & Odena, A. (2018) · arXiv · doi:10.48550/arxiv.1805.08318 · Cited by 3,353
Barnes, C., Shechtman, E., Finkelstein, A., & Goldman, D. B. (2009) · ACM Transactions on Graphics · doi:10.1145/1531326.1531330 · Cited by 2,888
Unsupervised Representation Learning by Predicting Image Rotations
Gidaris, S., Singh, P., & Komodakis, N. (2018) · arXiv · doi:10.48550/arxiv.1803.07728 · Cited by 2,477
MVTec AD — A Comprehensive Real-World Dataset for Unsupervised Anomaly Detection
Bergmann, P., Fauser, M., Sattlegger, D., & Steger, C. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00982 · Cited by 2,203
Support Vector Method for Novelty Detection
Schölkopf, B., Williamson, R. C., Smola, A. J., Shawe-Taylor, J. S., & Platt, J. C. (1999) · Cited by 2,038
Gong, D., Liu, L., Le, V., Saha, B., Mansour, M. R., Venkatesh, S., & Van Den Hengel, A. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00179 · Cited by 1,930
Ruff, L., Vandermeulen, R. A., Görnitz, N., Deecke, L., Siddiqui, S. A., Binder, A., Müller, E., & Kloft, M. (2018) · International Conference on Machine Learning · Cited by 1,719
Learning Temporal Regularity in Video Sequences
Hasan, M., Choi, J., Neumann, J., Roy–Chowdhury, A. K., & Davis, L. S. (2016) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2016.86 · Cited by 1,549
Anomaly Detection Using Autoencoders with Nonlinear Dimensionality Reduction
Sakurada, M., & Yairi, T. (2014) · Proceedings of the MLSDA 2014 2nd Workshop on Machine Learning for Sensory Data Analysis · doi:10.1145/2689746.2689747 · Cited by 1,438
Jolliffe, I. T. (2014) · Wiley eBooks · doi:10.1002/9781118445112.stat06472 · Cited by 1,278
Big Transfer (BiT): General Visual Representation Learning
Kolesnikov, A., Beyer, L., Zhai, X., Puigcerver, J., Yung, J., Gelly, S., & Houlsby, N. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58558-7_29 · Cited by 1,039
Uninformed Students: Student-Teacher Anomaly Detection With Discriminative Latent Embeddings
Bergmann, P., Fauser, M., Sattlegger, D., & Steger, C. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00424 · Cited by 990
A Revisit of Sparse Coding Based Anomaly Detection in Stacked RNN Framework
Luo, W., Liu, W., & Gao, S. (2017) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.45 · Cited by 984
Deep Anomaly Detection with Outlier Exposure
Hendrycks, D., Mazeika, M., & Dietterich, T. (2018) · arXiv · doi:10.48550/arxiv.1812.04606 · Cited by 932
A Geometric Framework for Unsupervised Anomaly Detection: Detecting Intrusions in Unlabeled Data
Eskin, E., Arnold, A., Prerau, M., Portnoy, L., & Stolfo, S. (2002) · Advances in Information Security · doi:10.1007/978-1-4615-0953-0_4 · Cited by 683
Spatio-Temporal AutoEncoder for Video Anomaly Detection
Zhao, Y., Deng, B., Shen, C., Liu, Y., Lu, H., & Hua, X. (2017) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3123266.3123451 · Cited by 609
Deep Anomaly Detection Using Geometric TransformationsPreprint
Golan, I., & El‐Yaniv, R. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1805.10917 · Cited by 479
Outlier Detection with Kernel Density Functions
Latecki, L. J., Lazarević, A. M., & Pokrajac, D. (2007) · Lecture notes in computer science · doi:10.1007/978-3-540-73499-4_6 · Cited by 302
Classification-Based Anomaly Detection for General DataPreprint
Bergman, L., & Hoshen, Y. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2005.02359 · Cited by 294
Self-citationAnomaly Detection in Nanofibrous Materials by CNN-Based Self-Similarity
Napoletano, P., Piccoli, F., & Schettini, R. (2018) · Sensors · doi:10.3390/s18010209 · Cited by 285
Welinder, P., Branson, S., Mita, T., Wah, C., Schroff, F., Belongie, S., & Perona, P. (2010) · CaltechAUTHORS (California Institute of Technology) · Cited by 255
Attention Guided Anomaly Localization in Images
Venkataramanan, S., Peng, K.-C., Singh, R. V., & Mahalanobis, A. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58520-4_29 · Cited by 247
Image Anomaly Detection with Generative Adversarial Networks
Deecke, L., Vandermeulen, R. A., Ruff, L., Mandt, S., & Kloft, M. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-10925-7_1 · Cited by 227
Deep Nearest Neighbor Anomaly DetectionPreprint
Bergman, L., Cohen, N., & Hoshen, Y. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2002.10445 · Cited by 200
Self-citationA Benchmark for Anomaly Segmentation.Preprint
Hendrycks, D., Basart, S., Mazeika, M., Mostajabi, M., Steinhardt, J., & Song, D. X. (2019) · arXiv (Cornell University) · Cited by 52
Attribute Restoration Framework for Anomaly DetectionPreprint
Huang, C., Ye, F., Cao, J., Li, M., Zhang, Y., & Lu, C. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1911.10676 · Cited by 49
Inverse-Transform AutoEncoder for Anomaly Detection
Huang, C., Cao, J., Ye, F., Li, M., Zhang, Y., & Lu, C. (2019) · Cited by 33
Attention Guided Anomaly Detection and Localization in Images.Preprint
Venkataramanan, S., Peng, K., Singh, R., & Mahalanobis, A. (2019) · arXiv (Cornell University) · Cited by 11
Differentiable Pooling for Hierarchical Feature LearningPreprint
Zeiler, M. D., & Fergus, R. (2012) · arXiv (Cornell University) · doi:10.48550/arxiv.1207.0151 · Cited by 9
Cited by
Sorted by citations
Towards Total Recall in Industrial Anomaly Detection
Roth, K., Pemula, L., Zepeda, J., Scholkopf, B., Brox, T., & Gehler, P. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01392 · Cited by 1,810
“This issue has already been noted in SPADE [10] for anomaly segmentation, which makes use of both low- and high-level feature maps.”
BackgroundMethodResultInfluentialPaDiM: A Patch Distribution Modeling Framework for Anomaly Detection and Localization
Defard, T., Setkov, A., Loesch, A., & Audigier, R. (2021) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-68799-1_35 · Cited by 1,415
CutPaste: Self-Supervised Learning for Anomaly Detection and Localization
Li, C.-L., Sohn, K., Yoon, J., & Pfister, T. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00954 · Cited by 1,107
Anomaly Detection via Reverse Distillation from One-Class Embedding
Deng, H., & Li, X. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.00951 · Cited by 1,016
Gudovskiy, D., Ishizaka, S., & Kozuka, K. (2022) · 2022 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV) · doi:10.1109/wacv51458.2022.00188 · Cited by 669
Metadata
- Authors
- Cohen, N., & Hoshen, Y.
- Affiliations
- Hebrew University of Jerusalem (IL)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2020
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 2005.02357
- OpenAlex
- W3023868590
- Cited by
- 372
- References
- 45
- Citations by year
- 2026: 6 · 2025: 58 · 2024: 128 · 2023: 102 · 2022: 44 · 2021: 34
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Anomaly Detection Techniques and Applications
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Engineering › Industrial and Manufacturing Engineering › Industrial Vision Systems and Defect Detection
- Keywords
- anomaly localization, anomaly segmentation, feature matching, unsupervised anomaly detection, semantic segmentation, Spades
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
