DRÆM – A discriminatively trained reconstruction embedding for surface anomaly detection
Abstract
Visual surface anomaly detection aims to detect local image regions that significantly deviate from normal appearance. Recent surface anomaly detection methods rely on generative models to accurately reconstruct the normal areas and to fail on anomalies. These methods are trained only on anomaly-free images, and often require hand-crafted post-processing steps to localize the anomalies, which prohibits optimizing the feature extraction for maximal detection capability. In addition to reconstructive approach, we cast surface anomaly detection primarily as a discriminative problem and propose a discriminatively trained reconstruction anomaly embedding model (DRÆM). The proposed method learns a joint representation of an anomalous image and its anomaly-free reconstruction, while simultaneously learning a decision boundary between normal and anomalous examples. The method enables direct anomaly localization without the need for additional complicated post-processing of the network output and can be trained using simple and general anomaly simulations. On the challenging MVTec anomaly detection dataset, DRÆM outperforms the current state-of-the-art unsupervised methods by a large margin and even de-livers detection performance close to the fully-supervised methods on the widely used DAGM surface-defect detection dataset, while substantially outperforming them in localization accuracy. Code at github.com/VitjanZ/DRAEM.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
DRAEM uses U-Net to outperform other methods on pixel-level anomaly segmentation.
“DRAEM [91] also uses U-Net to outperform other methods on pixel-level anomaly segmentation.”
From Deep Industrial Image Anomaly Detection: A Survey (2024) · cites this paper as [91]
Many unsupervised anomaly detection works use data augmentation to synthesize anomaly images and significantly improve model performance.
“There are many unsupervised anomaly detection works that use data augmentation to synthetic anomaly images and significantly improve model performance.”
From Deep Industrial Image Anomaly Detection: A Survey (2024) · cites this paper as [91]
CutPaste, DRAEM, and MemSeg are representative methods of unsupervised anomaly detection using data augmentation to synthesize anomaly images.
“For examples, CutPaste [31] , DRAEM [91] , MemSeg [18] are representative methods.”
From Deep Industrial Image Anomaly Detection: A Survey (2024) · cites this paper as [91]
DRAEM ceases to be effective under the unified case.
“However, DRAEM [53] ceases to be effective under the unified case.”
From A Unified Model for Multi-Class Anomaly Detection (2022) · cites this paper as [53]
Existing unsupervised anomaly detection methods train separate models for different object classes.
“Despite the rapid advance of unsupervised anomaly detection, existing methods require to train separate models for different objects.”
From A Unified Model for Multi-Class Anomaly Detection (2022) · cites this paper as [53]
Cites
U-Net: Convolutional Networks for Biomedical Image Segmentation
Ronneberger, O., Fischer, P., & Brox, T. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-24574-4_28 · Cited by 99,404 · see citing works
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333 · see citing works
Image quality assessment: from error visibility to structural similarity
Wang, Z., Bovik, A. C., Sheikh, H. R., & Simoncelli, E. P. (2004) · IEEE Transactions on Image Processing · doi:10.1109/tip.2003.819861 · Cited by 57,892 · see citing works
Focal Loss for Dense Object Detection
Lin, T.-Y., Goyal, P., Girshick, R., He, K., & Dollar, P. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.324 · Cited by 30,581 · see citing works
Labaca-Castro, R. (2023) · Springer eBooks · doi:10.1007/978-3-658-40442-0_9 · Cited by 21,100 · see citing works
Rethinking Atrous Convolution for Semantic Image Segmentation
Chen, L.-C., Papandreou, G., Schroff, F., & Adam, H. (2017) · arXiv · doi:10.48550/arxiv.1706.05587 · Cited by 7,517 · see citing works
Randaugment: Practical automated data augmentation with a reduced search space
Cubuk, E. D., Zoph, B., Shlens, J., & Le, Q. V. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw50498.2020.00359 · Cited by 3,223 · see citing works
Unsupervised Anomaly Detection with Generative Adversarial Networks to Guide Marker Discovery
Schlegl, T., Seeböck, P., Waldstein, S. M., Schmidt-Erfurth, U., & Langs, G. (2017) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-59050-9_12 · Cited by 2,627 · see citing works
Describing Textures in the Wild
Cimpoi, M., Maji, S., Kokkinos, I., Mohamed, S., & Vedaldi, A. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.461 · Cited by 2,438 · see citing works
Perlin, K. (1985) · ACM SIGGRAPH Computer Graphics · doi:10.1145/325165.325247 · Cited by 2,091 · see citing works
Ruff, L., Vandermeulen, R. A., Görnitz, N., Deecke, L., Siddiqui, S. A., Binder, A., Müller, E., & Kloft, M. (2018) · International Conference on Machine Learning · Cited by 1,719 · see citing works
Future Frame Prediction for Anomaly Detection - A New Baseline
Liu, W., Luo, W., Lian, D., & Gao, S. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00684 · Cited by 1,601 · see citing works
f-AnoGAN: Fast unsupervised anomaly detection with generative adversarial networks
Schlegl, T., Seeböck, P., Waldstein, S. M., Langs, G., & Schmidt-Erfurth, U. M. (2019) · Medical Image Analysis · doi:10.1016/j.media.2019.01.010 · Cited by 1,561 · see citing works
PaDiM: A Patch Distribution Modeling Framework for Anomaly Detection and Localization
Defard, T., Setkov, A., Loesch, A., & Audigier, R. (2021) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-68799-1_35 · Cited by 1,415 · see citing works
Uninformed Students: Student-Teacher Anomaly Detection With Discriminative Latent Embeddings
Bergmann, P., Fauser, M., Sattlegger, D., & Steger, C. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00424 · Cited by 990 · see citing works
Improving Unsupervised Defect Segmentation by Applying Structural Similarity to Autoencoders
Bergmann, P., Löwe, S., Fauser, M., Sattlegger, D., & Steger, C. T. (2019) · International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP) · doi:10.5220/0007364503720380 · Cited by 819 · see citing works
Reconstruction by inpainting for visual anomaly detection
Zavrtanik, V., Kristan, M., & Skočaj, D. (2020) · Pattern Recognition · doi:10.1016/j.patcog.2020.107706 · Cited by 752 · see citing works
Self-citationPatch SVDD: Patch-Level SVDD for Anomaly Detection and Segmentation
Yi, J., & Yoon, S. (2021) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-69544-6_23 · Cited by 551 · see citing works
Towards Visually Explaining Variational Autoencoders
Liu, W., Li, R., Zheng, M., Karanam, S., Wu, Z., Bhanu, B., Radke, R. J., & Camps, O. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00867 · Cited by 294 · see citing works
Modeling the Distribution of Normal Data in Pre-Trained Deep Features for Anomaly Detection
Rippel, O., Mertens, P., & Merhof, D. (2021) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr48806.2021.9412109 · Cited by 280 · see citing works
Unsupervised anomaly segmentation via deep feature reconstruction
Shi, Y., Yang, J., & Qi, Z. (2020) · Neurocomputing · doi:10.1016/j.neucom.2020.11.018 · Cited by 233 · see citing works
Tang, T., Kuo, W.-H., Lan, J.-H., Ding, C., Hsu, H., & Young, H. (2020) · Sensors · doi:10.3390/s20123336 · Cited by 149 · see citing works
A Compact Convolutional Neural Network for Textured Surface Anomaly Detection
Rački, D., Tomaževič, D., & Skočaj, D. (2018) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv.2018.00150 · Cited by 106 · see citing works
Skip-GANomaly: Skip Connected and Adversarially Trained Encoder-Decoder Anomaly Detection
Akcay, S., Atapour-Abarghouei, A., & Breckon, T. P. (2019) · 2019 International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2019.8851808 · Cited by 103 · see citing works
Zhang, J., Su, H., Zou, W., Gong, X., Zhang, Z., & Shen, F. (2020) · Pattern Recognition · doi:10.1016/j.patcog.2020.107571 · Cited by 94 · see citing works
End-to-end training of a two-stage neural network for defect detection
Božič, J., Tabernik, D., & Skočaj, D. (2021) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr48806.2021.9412092 · Cited by 77 · see citing works
An Efficient Network for Surface Defect Detection
Lin, Z., Ye, H., Zhan, B., & Huang, X. (2020) · Applied Sciences · doi:10.3390/app10176085 · Cited by 53 · see citing works
Weakly Supervised Learning for Industrial Optical Inspection
Wieler, M., Hahn, T., & Hamprecht, F. A. (2007) · Zenodo (CERN European Organization for Nuclear Research) · doi:10.5281/zenodo.8086135 · Cited by 27 · see citing works
Mirrored Autoencoders with Simplex Interpolation for Unsupervised Anomaly Detection.Preprint
Wu, Y., Balaji, Y., Vinzamuri, B., et al. (2020) · arXiv (Cornell University) · Cited by 3 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
WinCLIP: Zero-/Few-Shot Anomaly Classification and Segmentation
Jeong, J., Zou, Y., Kim, T., Zhang, D., Ravichandran, A., & Dabeer, O. (2023) · 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52729.2023.01878 · Cited by 585 · see citing works
Deep Industrial Image Anomaly Detection: A Survey
Liu, J., Xie, G., Wang, J., Li, S., Wang, C., Zheng, F., & Jin, Y. (2024) · Machine Intelligence Research · doi:10.1007/s11633-023-1459-z · Cited by 463 · see citing works
“The paper generates abnormal samples in feature level and perform better than DRAEM.”
MethodInfluentialSelf-Supervised Predictive Convolutional Attentive Block for Anomaly Detection
Ristea, N.-C., Madan, N., Ionescu, R. T., Nasrollahi, K., Khan, F. S., Moeslund, T. B., & Shah, M. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01321 · Cited by 315 · see citing works
Asymmetric Student-Teacher Networks for Industrial Anomaly Detection
Rudolph, M., Wehrbein, T., Rosenhahn, B., & Wandt, B. (2023) · 2023 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV) · doi:10.1109/wacv56688.2023.00262 · Cited by 280 · see citing works
Yang, M., Wu, P., & Feng, H. (2023) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2023.105835 · Cited by 257 · see citing works
A Unified Model for Multi-Class Anomaly Detection
You, Z., Cui, L., Shen, Y., Yang, K., Lu, X., Zheng, Y., & Le, X. (2022) · Advances in Neural Information Processing Systems 35 · doi:10.52202/068431-0330 · Cited by 303 · see citing works
Yang, Q., & Guo, R. (2024) · Sensors · doi:10.3390/s24082440 · Cited by 35 · see citing works
Logit Inducing With Abnormality Capturing for Semi-Supervised Image Anomaly Detection
Wan, Q., Gao, L., & Li, X. (2022) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2022.3205674 · Cited by 22 · see citing works
ZUMA: Training-Free Zero-Shot Unified Multimodal Anomaly Detection
Ma, Y., Liu, M., Jiang, S., Zhou, J., Bian, Y., Wang, X., & Wang, Y. (2026) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2026.3658856 · Cited by 4 · see citing works
- Authors
- Zavrtanik, V., Kristan, M., & Skocaj, D.
- Affiliations
- University of Ljubljana (SI)
- University of Ljubljana,Faculty of Computer and Information Science
- ORCID
- Kristan, Matej
- Venue
- 2021 IEEE/CVF International Conference on Computer Vision (ICCV)
- Publisher
- IEEE
- Published
- 2021-10
- Pages
- 8310-8319
- OpenAlex
- W4214694907
- Cited by
- 1,086
- References
- 29
- Citations by year
- 2026: 298 · 2025: 342 · 2024: 293 · 2023: 122 · 2022: 30 · 2021: 1
- FWCI
- 153.09
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- IEEE/CVF International Conference on Computer Vision (ICCV) (publishedVersion)
- Topics
- Physical Sciences › Engineering › Industrial and Manufacturing Engineering › Industrial Vision Systems and Defect Detection
- Physical Sciences › Computer Science › Artificial Intelligence › Anomaly Detection Techniques and Applications
- Physical Sciences › Engineering › Civil and Structural Engineering › Infrastructure Maintenance and Monitoring
- Keywords
- surface anomaly detection, image anomaly detection, anomaly localization, unsupervised anomaly detection, surface defect detection, decision boundary learning
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review