Informative knowledge distillation for image anomaly segmentation

Deep Residual Learning for Image Recognition

He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474

ImageNet: A large-scale hierarchical image database

Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333

An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale

Dosovitskiy, A., Beyer, L., Kolesnikov, A., Weissenborn, D., Zhai, X., Unterthiner, T., Dehghani, M., Minderer, M., Heigold, G., Gelly, S., et al. (2020) · arXiv · doi:10.48550/arxiv.2010.11929 · Cited by 47,472

Untitled work

(2008) · Journal of Machine Learning Research · Cited by 33,051

Proceedings of IEEE Conference on Computer Vision and Pattern Recognition

(1993) · doi:10.1109/cvpr.1993 · Cited by 17,989

Nearest neighbor pattern classification

Cover, T., & Hart, P. (1967) · IEEE Transactions on Information Theory · doi:10.1109/tit.1967.1053964 · Cited by 16,936

Distilling the Knowledge in a Neural Network

Hinton, G., Vinyals, O., & Dean, J. (2015) · arXiv · doi:10.48550/arxiv.1503.02531 · Cited by 14,204

Advances in Neural Information Processing Systems 29

Teymur, O., Zygalakis, K., & Calderhead, B. (2016) · Cited by 13,881

Proceedings of IEEE International Conference on Computer Vision

(1995) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.1995.466933 · Cited by 13,117

Deep High-Resolution Representation Learning for Visual Recognition

Wang, J., Sun, K., Cheng, T., Jiang, B., Deng, C., Zhao, Y., Liu, D., Mu, Y., Tan, M., Wang, X., et al. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2020.2983686 · Cited by 4,894

Knowledge Distillation: A Survey

Gou, J., Yu, B., Maybank, S. J., & Tao, D. (2021) · International Journal of Computer Vision · doi:10.1007/s11263-021-01453-z · Cited by 3,931

FitNets: Hints for Thin Deep Nets

Romero, A., Ballas, N., Kahou, S. E., Chassang, A., Gatta, C., & Bengio, Y. (2014) · arXiv · doi:10.48550/arxiv.1412.6550 · Cited by 2,859

Deep Learning for Anomaly Detection: A Review

Pang, G., Shen, C., Cao, L., & Hengel, A. V. D. (2022) · ACM Computing Surveys · doi:10.1145/3439950 · Cited by 2,837

Unsupervised Anomaly Detection with Generative Adversarial Networks to Guide Marker Discovery

Schlegl, T., Seeböck, P., Waldstein, S. M., Schmidt-Erfurth, U., & Langs, G. (2017) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-59050-9_12 · Cited by 2,627

Memorizing Normality to Detect Anomaly: Memory-Augmented Deep Autoencoder for Unsupervised Anomaly Detection

Gong, D., Liu, L., Le, V., Saha, B., Mansour, M. R., Venkatesh, S., & Van Den Hengel, A. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00179 · Cited by 1,930

Deep One-Class Classification

Ruff, L., Vandermeulen, R. A., Görnitz, N., Deecke, L., Siddiqui, S. A., Binder, A., Müller, E., & Kloft, M. (2018) · International Conference on Machine Learning · Cited by 1,719

Deep Learning for Anomaly Detection: A Review

Pang, G., Shen, C., Cao, L., et al. (2020) · Singapore Management University Institutional Knowledge (InK) (Singapore Management University) · doi:10.48550/arxiv.2007.02500 · Cited by 1,718

A review of novelty detection

Pimentel, M. A. F., Clifton, D. A., Clifton, L., & Tarassenko, L. (2014) · Signal Processing · doi:10.1016/j.sigpro.2013.12.026 · Cited by 1,649

f-AnoGAN: Fast unsupervised anomaly detection with generative adversarial networks

Schlegl, T., Seeböck, P., Waldstein, S. M., Langs, G., & Schmidt-Erfurth, U. M. (2019) · Medical Image Analysis · doi:10.1016/j.media.2019.01.010 · Cited by 1,645

PaDiM: A Patch Distribution Modeling Framework for Anomaly Detection and Localization

Defard, T., Setkov, A., Loesch, A., & Audigier, R. (2021) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-68799-1_35 · Cited by 1,415

Similarity-Preserving Knowledge Distillation

Tung, F., & Mori, G. (2019) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00145 · Cited by 1,219

Uninformed Students: Student-Teacher Anomaly Detection With Discriminative Latent Embeddings

Bergmann, P., Fauser, M., Sattlegger, D., & Steger, C. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00424 · Cited by 990

Improving Unsupervised Defect Segmentation by Applying Structural Similarity to Autoencoders

Bergmann, P., Löwe, S., Fauser, M., Sattlegger, D., & Steger, C. T. (2019) · International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP) · doi:10.5220/0007364503720380 · Cited by 893

International Conference on Pattern Recognition

(1971) · Computer · doi:10.1109/c-m.1971.216793 · Cited by 828

Reconstruction by inpainting for visual anomaly detection

Zavrtanik, V., Kristan, M., & Skočaj, D. (2020) · Pattern Recognition · doi:10.1016/j.patcog.2020.107706 · Cited by 752

CurricularFace: Adaptive Curriculum Learning Loss for Deep Face Recognition

Huang, Y., Wang, Y., Tai, Y. Y., Liu, X., Shen, P., Li, S., Li, J., & Huang, F. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.00594 · Cited by 641

The MVTec Anomaly Detection Dataset: A Comprehensive Real-World Dataset for Unsupervised Anomaly Detection

Bergmann, P., Batzner, K., Fauser, M., Sattlegger, D., & Steger, C. (2021) · International Journal of Computer Vision · doi:10.1007/s11263-020-01400-4 · Cited by 602

Patch SVDD: Patch-Level SVDD for Anomaly Detection and Segmentation

Yi, J., & Yoon, S. (2021) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-69544-6_23 · Cited by 551

Working hard to know your neighbor's margins: Local descriptor learning lossPreprint

Mishchuk, A., Mishkin, D., Radenović, F., & Matas, J. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1705.10872 · Cited by 540

Deep Anomaly Detection Using Geometric TransformationsPreprint

Golan, I., & El‐Yaniv, R. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1805.10917 · Cited by 479

Student-Teacher Feature Pyramid Matching for Anomaly Detection

Wang, G., Han, S., Ding, E., & Huang, D. (2021) · British Machine Vision Conference (BMVC) · doi:10.5244/c.35.349 · Cited by 459

Surface Defect Detection Methods for Industrial Products: A Review

Chen, Y., Ding, Y., Zhao, F., Zhang, E., Wu, Z., & Shao, L. (2021) · Applied Sciences · doi:10.3390/app11167657 · Cited by 457

Learning Discriminative Reconstructions for Unsupervised Outlier Removal

Xia, Y., Cao, X., Wen, F., Hua, G., & Sun, J. Z. (2015) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.177 · Cited by 301

PANDA: Adapting Pretrained Features for Anomaly Detection and Segmentation

Reiss, T., Cohen, N., Bergman, L., & Hoshen, Y. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.00283 · Cited by 295

adVAE: A self-adversarial variational autoencoder with Gaussian anomaly prior knowledge for anomaly detection

Wang, X., Du, Y., Lin, S., Cui, P. Y., Shen, Y., & Yang, Y. (2019) · Knowledge-Based Systems · doi:10.1016/j.knosys.2019.105187 · Cited by 149

Learning Student Networks via Feature Embedding

Chen, H., Wang, Y., Xu, C., Xu, C., & Tao, D. (2020) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2020.2970494 · Cited by 116

Information Processing in Medical Imaging

Sun, H., Zhen, X., Bailey, C., Rasoulinejad, P., Yin, Y., & Li, S. (2017) · Lecture notes in computer science · doi:10.1007/978-3-319-59050-9 · Cited by 115

Iterative energy-based projection on a normal data manifold for anomaly localizationPreprint

Dehaene, D., Frigo, O., Combrexelle, S., & Eline, P. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2002.03734 · Cited by 112

Student-Teacher Feature Pyramid Matching for Anomaly DetectionPreprint

Wang, G., Han, S., Ding, E., et al. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2103.04257 · Cited by 105

Notice of Removal: Multiresolution Knowledge Distillation for Anomaly Detection

Salehi, M., Sadjadi, N., Baselizadeh, S., Rohban, M. H., & Rabiee, H. R. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.01466 · Cited by 97

Industrial Image Anomaly Localization Based on Gaussian Clustering of Pretrained Feature

Wan, Q., Gao, L., Li, X., & Wen, L. (2022) · IEEE Transactions on Industrial Electronics · doi:10.1109/tie.2021.3094452 · Cited by 94

Gaussian Anomaly Detection by Modeling the Distribution of Normal Data in Pretrained Deep Features

Rippel, O., Mertens, P., Konig, E., & Merhof, D. (2021) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2021.3098381 · Cited by 88

Unsupervised Anomaly Segmentation Via Multilevel Image Reconstruction and Adaptive Attention-Level Transition

Yan, Y., Wang, D., Zhou, G., & Chen, Q. (2021) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2021.3107586 · Cited by 60

Knowledge transfer in fault diagnosis of rotary machines

Liu, G., Shen, W., Gao, L., & Kusiak, A. (2022) · IET Collaborative Intelligent Manufacturing · doi:10.1049/cim2.12047 · Cited by 44

Unsupervised Anomaly Detection Using Style Distillation

Chung, H., Park, J.-H., Keum, J., Ki, H., & Kang, S. (2020) · IEEE Access · doi:10.1109/access.2020.3043473 · Cited by 35

Self-Attention Autoencoder for Anomaly SegmentationPreprint

Yang, Y. (2021) · Preprints.org · doi:10.20944/preprints202108.0570.v1 · Cited by 2

Deep Industrial Image Anomaly Detection: A Survey

Liu, J., Xie, G., Wang, J., Li, S., Wang, C., Zheng, F., & Jin, Y. (2024) · Machine Intelligence Research · doi:10.1007/s11633-023-1459-z · Cited by 463

A Diffusion-Based Framework for Multi-Class Anomaly Detection

He, H., Zhang, J., Chen, H., Chen, X., Li, Z., Chen, X., Wang, Y., Wang, C., & Xie, L. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i8.28690 · Cited by 271

AnomalyDiffusion: Few-Shot Anomaly Image Generation with Diffusion Model

Hu, T., Zhang, J., Yi, R., Du, Y., Chen, X., Liu, L., Wang, Y., & Wang, C. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i8.28696 · Cited by 192

AdaCLIP: Adapting CLIP with Hybrid Learnable Prompts for Zero-Shot Anomaly Detection

Cao, Y., Zhang, J., Frittoli, L., Cheng, Y., Shen, W., & Boracchi, G. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-72761-0_4 · Cited by 193

Collaborative Discrepancy Optimization for Reliable Image Anomaly Localization

Cao, Y., Xu, X., Liu, Z., & Shen, W. (2023) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2023.3241579 · Cited by 154

A masked reverse knowledge distillation method incorporating global and local information for image anomaly detection

Jiang, Y., Cao, Y., & Shen, W. (2023) · Knowledge-Based Systems · doi:10.1016/j.knosys.2023.110982 · Cited by 52

Abnormal-Aware Loss and Full Distillation for Unsupervised Anomaly Detection Based on Knowledge Distillation

Zhao, M., & Song, Y. (2023) · Proceedings - International Conference on Image Processing · doi:10.1109/icip49359.2023.10222157 · Cited by 2

Unsupervised anomaly detection and localization via bidirectional knowledge distillation

Wang, X., Wang, Y., Pan, Z., & Wang, G. (2024) · Neural Computing and Applications · doi:10.1007/s00521-024-10172-8 · Cited by 7

Semantic-Guided Denoising Knowledge Distillation Model for Anomaly Detection

Zhang, J., Guo, N., Wang, J., Li, C., & Liu, Z. (2026) · Lecture notes in computer science · doi:10.1007/978-981-95-5696-0_27

ADPS: Asymmetric Distillation Postsegmentation for Image Anomaly Detection

Xing, P., Tang, H., Tang, J., & Li, Z. (2024) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2024.3390806 · Cited by 20