The DOI matches its Crossref record; 61 of the 61 references it cites were found in a registry or an index.
EfficientAD: Accurate Visual Anomaly Detection at Millisecond-Level Latencies
Open accessAbstract
Detecting anomalies in images is an important task, especially in real-time computer vision applications. In this work, we focus on computational efficiency and propose a lightweight feature extractor that processes an image in less than a millisecond on a modern GPU. We then use a student–teacher approach to detect anomalous features. We train a student network to predict the extracted features of normal, i.e., anomaly-free training images. The detection of anomalies at test time is enabled by the student failing to predict their features. We propose a training loss that hinders the student from imitating the teacher feature extractor beyond the normal images. It allows us to drastically reduce the computational cost of the student–teacher model, while improving the detection of anomalous features. We furthermore address the detection of challenging logical anomalies that involve invalid combinations of normal local features, for example, a wrong ordering of objects. We detect these anomalies by efficiently incorporating an autoencoder that analyzes images globally. We evaluate our method, called EfficientAD, on 32 datasets from three industrial anomaly detection dataset collections. EfficientAD sets new standards for both the detection and the localization of anomalies. At a latency of two milliseconds and a throughput of six hundred images per second, it enables a fast handling of anomalies. Together with its low error rate, this makes it an economical solution for real-world applications and a fruitful basis for future research.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
U-Net: Convolutional Networks for Biomedical Image Segmentation
Ronneberger, O., Fischer, P., & Brox, T. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-24574-4_28 · Cited by 99,404
You Only Look Once: Unified, Real-Time Object Detection
Redmon, J., Divvala, S., Girshick, R., & Farhadi, A. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.91 · Cited by 53,803
Densely Connected Convolutional Networks
Huang, G., Liu, Z., Van Der Maaten, L., & Weinberger, K. Q. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.243 · Cited by 48,566
ImageNet Large Scale Visual Recognition Challenge
Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., Bernstein, M., et al. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-015-0816-y · Cited by 39,380
Swin Transformer: Hierarchical Vision Transformer using Shifted Windows
Liu, Z., Lin, Y., Cao, Y., Hu, H., Wei, Y., Zhang, Z., Lin, S., & Guo, B. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00986 · Cited by 35,534
PyTorch: An Imperative Style, High-Performance Deep Learning Library
Paszke, A., Gross, S., Massa, F., Lerer, A., Bradbury, J., Chanan, G., Killeen, T., Lin, Z., Gimelshein, N., Antiga, L., et al. (2019) · arXiv · doi:10.48550/arxiv.1912.01703 · Cited by 31,473
MobileNetV2: Inverted Residuals and Linear Bottlenecks
Sandler, M., Howard, A., Zhu, M., Zhmoginov, A., & Chen, L.-C. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00474 · Cited by 28,755
EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks
Tan, M., & Le, Q. V. (2019) · arXiv · doi:10.48550/arxiv.1905.11946 · Cited by 17,072 · cited 2×
“Modern classification architectures, for example, focus on characteristics such as latency, throughput, memory consumption, and the number of trainable parameters [34, 35, 57, 62, 63, 67].”
BackgroundEfficientDet: Scalable and Efficient Object Detection
Tan, M., Pang, R., & Le, Q. V. (2019) · arXiv · Cited by 9,841 · cited 2×
“This progress has been accompanied by advances in making neural network architectures faster and more efficient [46, 62, 64, 67].”
BackgroundLiu, Z., Mao, H., Wu, C.-Y., Feichtenhofer, C., Darrell, T., & Xie, S. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01167 · Cited by 8,494
Zagoruyko, S., & Komodakis, N. (2016) · Procedings of the British Machine Vision Conference 2016 · doi:10.5244/c.30.87 · Cited by 7,244
The multimodal brain tumor image segmentation benchmark (BRATS)
Menze, B. H., Jakab, A., Bauer, S., Kalpathy-Cramer, J., Farahani, K., Kirby, J., Burren, Y., Porz, N., Slotboom, J., Wiest, R., et al. (2015) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2014.2377694 · Cited by 6,781
The relationship between Precision-Recall and ROC curves
Davis, J., & Goadrich, M. (2006) · Proceedings of the 23rd international conference on Machine learning - ICML '06 · doi:10.1145/1143844.1143874 · Cited by 6,559
Bakas, S., Akbari, H., Sotiras, A., Bilello, M., Rozycki, M., Kirby, J. S., Freymann, J. B., Farahani, K., & Davatzikos, C. (2017) · Scientific Data · doi:10.1038/sdata.2017.117 · Cited by 3,049
Armato, S. G., McLennan, G., Bidaut, L., McNitt‐Gray, M. F., Meyer, C. R., Reeves, A. P., Zhao, B., Aberle, D. R., Henschke, C. I., Hoffman, E. A., et al. (2011) · Medical Physics · doi:10.1118/1.3528204 · Cited by 2,887 · cited 2×
“Applications often have specific characteristics, such as the availability of image sequences in surveillance datasets [29, 35, 67] or the different modalities of medical imaging datasets (MRI [5], CT [3], X-ray [26], etc.).”
BackgroundDeep Learning for Anomaly Detection: A Review
Pang, G., Shen, C., Cao, L., & Hengel, A. V. D. (2022) · ACM Computing Surveys · doi:10.1145/3439950 · Cited by 2,837
Training Region-Based Object Detectors with Online Hard Example Mining
Shrivastava, A., Gupta, A., & Girshick, R. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.89 · Cited by 2,686 · cited 3×
“[60] Abhinav Shrivastava, Abhinav Gupta, and Ross Girshick.”
BackgroundInfluentialUnsupervised Anomaly Detection with Generative Adversarial Networks to Guide Marker Discovery
Schlegl, T., Seeböck, P., Waldstein, S. M., Schmidt-Erfurth, U., & Langs, G. (2017) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-59050-9_12 · Cited by 2,627
Single-Image Crowd Counting via Multi-Column Convolutional Neural Network
Zhang, Y., Zhou, D., Chen, S., Gao, S., & Ma, Y. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.70 · Cited by 2,241
MVTec AD — A Comprehensive Real-World Dataset for Unsupervised Anomaly Detection
Bergmann, P., Fauser, M., Sattlegger, D., & Steger, C. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00982 · Cited by 2,203 · cited 5×
“[7, 9] has catalyzed the development of methods for industrial applications.”
BackgroundMethodInfluentialGong, D., Liu, L., Le, V., Saha, B., Mansour, M. R., Venkatesh, S., & Van Den Hengel, A. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00179 · Cited by 1,930
Towards Total Recall in Industrial Anomaly Detection
Roth, K., Pemula, L., Zepeda, J., Scholkopf, B., Brox, T., & Gehler, P. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01392 · Cited by 1,810 · cited 10×
“[50] Karsten Roth, Latha Pemula, Joaquin Zepeda, Bernhard Schölkopf, Thomas Brox, and Peter Gehler.”
BackgroundMethodResultInfluentialf-AnoGAN: Fast unsupervised anomaly detection with generative adversarial networks
Schlegl, T., Seeböck, P., Waldstein, S. M., Langs, G., & Schmidt-Erfurth, U. (2019) · Medical Image Analysis · doi:10.1016/j.media.2019.01.010 · Cited by 1,545
Anomaly Detection Using Autoencoders with Nonlinear Dimensionality Reduction
Sakurada, M., & Yairi, T. (2014) · Proceedings of the MLSDA 2014 2nd Workshop on Machine Learning for Sensory Data Analysis · doi:10.1145/2689746.2689747 · Cited by 1,438
Abnormal Event Detection at 150 FPS in MATLAB
Lu, C., Shi, J., & Jia, J. (2013) · 2013 IEEE International Conference on Computer Vision · doi:10.1109/iccv.2013.338 · Cited by 1,436
PaDiM: A Patch Distribution Modeling Framework for Anomaly Detection and Localization
Defard, T., Setkov, A., Loesch, A., & Audigier, R. (2021) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-68799-1_35 · Cited by 1,415
British Machine Vision Conference (BMVC)
Damen, D., & Hogg, D. (2007) · Cited by 1,213
CutPaste: Self-Supervised Learning for Anomaly Detection and Localization
Li, C.-L., Sohn, K., Yoon, J., & Pfister, T. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00954 · Cited by 1,107
Anomaly Detection and Localization in Crowded Scenes
Li, W., Mahadevan, V., & Vasconcelos, N. (2014) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2013.111 · Cited by 1,017
Uninformed Students: Student-Teacher Anomaly Detection With Discriminative Latent Embeddings
Bergmann, P., Fauser, M., Sattlegger, D., & Steger, C. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00424 · Cited by 990
Learning Memory-Guided Normality for Anomaly Detection
Park, H., Noh, J., & Ham, B. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.01438 · Cited by 929
Gudovskiy, D., Ishizaka, S., & Kozuka, K. (2022) · 2022 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV) · doi:10.1109/wacv51458.2022.00188 · Cited by 669
SPot-the-Difference Self-supervised Pre-training for Anomaly Detection and Segmentation
Zou, Y., Jeong, J., Pemula, L., Zhang, D., & Dabeer, O. (2022) · Lecture Notes in Computer Science · doi:10.1007/978-3-031-20056-4_23 · Cited by 651
SimpleNet: A Simple Network for Image Anomaly Detection and Localization
Liu, Z., Zhou, Y., Xu, Y., & Wang, Z. (2023) · 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52729.2023.01954 · Cited by 646
OCGAN: One-Class Novelty Detection Using GANs With Constrained Latent Representations
Perera, P., Nallapati, R., & Xiang, B. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00301 · Cited by 608
Bergmann, P., Batzner, K., Fauser, M., Sattlegger, D., & Steger, C. (2021) · International Journal of Computer Vision · doi:10.1007/s11263-020-01400-4 · Cited by 602 · cited 10×
“[7] evaluate some of these methods and find that they fail when requirements such as wellaligned objects are not met.”
BackgroundMethodResultInfluentialSelf-citationSame Same But DifferNet: Semi-Supervised Defect Detection with Normalizing Flows
Rudolph, M., Wandt, B., & Rosenhahn, B. (2021) · 2021 IEEE Winter Conference on Applications of Computer Vision (WACV) · doi:10.1109/wacv48630.2021.00195 · Cited by 489
Machine vision algorithms and applications
(2008) · Choice Reviews Online · doi:10.5860/choice.46-0907 · Cited by 464
VT-ADL: A Vision Transformer Network for Image Anomaly Detection and Localization
Mishra, P., Verk, R., Fornasier, D., Piciarelli, C., & Foresti, G. L. (2021) · 2021 IEEE 30th International Symposium on Industrial Electronics (ISIE) · doi:10.1109/isie45552.2021.9576231 · Cited by 462 · cited 2×
“Recently, several new industrial anomaly detection datasets have been introduced [8, 11, 25, 27, 37, 69].”
BackgroundMethodDeep Autoencoding Models for Unsupervised Anomaly Segmentation in Brain MR Images
Baur, C., Wiestler, B., Albarqouni, S., & Navab, N. (2019) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-11723-8_16 · Cited by 432
Deep Learning for Medical Anomaly Detection – A Survey
Fernando, T., Gammulle, H., Denman, S., Sridharan, S., & Fookes, C. (2022) · ACM Computing Surveys · doi:10.1145/3464423 · Cited by 399
CheXpert: A Large Chest Radiograph Dataset with Uncertainty Labels and Expert Comparison
Irvin, J., Rajpurkar, P., Ko, M., Yu, Y., Ciurea-Ilcus, S., Chute, C., Marklund, H., Haghgoo, B., Ball, R., Shpanskaya, K., et al. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.3301590 · Cited by 392
Sub-Image Anomaly Detection with Deep Pyramid Correspondences
Cohen, N., & Hoshen, Y. (2020) · arXiv · doi:10.48550/arxiv.2005.02357 · Cited by 372
Ježek, Š., Jonák, M., Bürget, R., Dvořák, P., & Skotak, M. (2021) · International Congress on Ultra Modern Telecommunications and Control Systems and Workshops (ICUMT) · doi:10.1109/icumt54235.2021.9631567 · Cited by 362
A-ViT: Adaptive Tokens for Efficient Vision Transformer
Yin, H., Vahdat, A., Alvarez, J. M., Mallya, A., Kautz, J., & Molchanov, P. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01054 · Cited by 360
Fully Convolutional Cross-Scale-Flows for Image-based Defect Detection
Rudolph, M., Wehrbein, T., Rosenhahn, B., & Wandt, B. (2022) · 2022 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV) · doi:10.1109/wacv51458.2022.00189 · Cited by 348
Improving Unsupervised Defect Segmentation by Applying Structural Similarity to Autoencoders
Bergmann, P., Löwe, S., Fauser, M., Sattlegger, D., & Steger, C. (2019) · Proceedings of the 14th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications · doi:10.5220/0007364500002108 · Cited by 336
Towards Visually Explaining Variational Autoencoders
Liu, W., Li, R., Zheng, M., Karanam, S., Wu, Z., Bhanu, B., Radke, R. J., & Camps, O. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00867 · Cited by 294
Beyond Dents and Scratches: Logical Constraints in Unsupervised Anomaly Detection and Localization
Bergmann, P., Batzner, K., Fauser, M., Sattlegger, D., & Steger, C. (2022) · International Journal of Computer Vision · doi:10.1007/s11263-022-01578-9 · Cited by 286
Self-citationAnomaly Detection in Nanofibrous Materials by CNN-Based Self-Similarity
Napoletano, P., Piccoli, F., & Schettini, R. (2018) · Sensors · doi:10.3390/s18010209 · Cited by 285
Asymmetric Student-Teacher Networks for Industrial Anomaly Detection
Rudolph, M., Wehrbein, T., Rosenhahn, B., & Wandt, B. (2023) · 2023 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV) · doi:10.1109/wacv56688.2023.00262 · Cited by 280
Anomalib: A Deep Learning Library for Anomaly Detection
Akçay, S., Ameln, D., Vaidya, A., Lakshmanan, B., Ahuja, N., & Genc, U. (2022) · Proceedings - International Conference on Image Processing · doi:10.1109/icip46576.2022.9897283 · Cited by 245
FastFlow: Unsupervised Anomaly Detection and Localization via 2D Normalizing Flows
Yu, J., Zheng, Y., Wang, X., Li, W., Wu, Y., Zhao, R., & Wu, L. (2021) · arXiv · doi:10.48550/arxiv.2111.07677 · Cited by 210
The MVTec 3D-AD Dataset for Unsupervised 3D Anomaly Detection and Localization
Bergmann, P., Jin, X., Sattlegger, D., & Steger, C. (2022) · Proceedings of the 17th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications · doi:10.5220/0010865000003124 · Cited by 198
Detecting the Unexpected via Image Resynthesis
Lis, K., Nakka, K. K., Fua, P., & Salzmann, M. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00224 · Cited by 174
DSR – A Dual Subspace Re-Projection Network for Surface Anomaly Detection
Zavrtanik, V., Kristan, M., & Skočaj, D. (2022) · Lecture Notes in Computer Science · doi:10.1007/978-3-031-19821-2_31 · Cited by 162
Fishyscapes: A Benchmark for Safe Semantic Segmentation in Autonomous Driving
Blum, H., Sarlin, P.-E., Nieto, J. I., Siegwart, R., & Cadena, C. (2019) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw.2019.00294 · Cited by 142
Surface Defect Saliency of Magnetic Tile
Huang, Y., Qiu, C., Guo, Y., Wang, X., & Yuan, K. (2018) · 2018 IEEE 14th International Conference on Automation Science and Engineering (CASE) · doi:10.1109/coase.2018.8560423 · Cited by 117
Image Anomalies: A Review and Synthesis of Detection Methods
Ehret, T., Davy, A., Morel, J., & Delbracio, M. (2019) · Journal of Mathematical Imaging and Vision · doi:10.1007/s10851-019-00885-0 · Cited by 69
Transfer Learning Gaussian Anomaly Detection by Fine-tuning Representations
Rippel, O., Chavan, A., Lei, C., & Merhof, D. (2022) · Proceedings of the 2nd International Conference on Image Processing and Vision Engineering · doi:10.5220/0011063900003209 · Cited by 17
Metadata
- Authors
- Batzner, K., Heckler, L., & König, R.
- Venue
- 2024 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV)
- Publisher
- IEEE
- Published
- 2024-01-03
- Pages
- 127-137
- OpenAlex
- W4394625793
- Cited by
- 386
- References
- 61
- FWCI
- 116.82
- Type
- conference paper
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.