Generalized ODIN: Detecting Out-of-Distribution Image Without Learning From Out-of-Distribution Data
Open accessAbstract
Deep neural networks have attained remarkable performance when applied to data that comes from the same distribution as that of the training set, but can significantly degrade otherwise. Therefore, detecting whether an example is out-of-distribution (OoD) is crucial to enable a system that can reject such samples or alert users. Recent works have made significant progress on OoD benchmarks consisting of small image datasets. However, many recent methods based on neural networks rely on training or tuning with both in-distribution and out-of-distribution data. The latter is generally hard to define a-priori, and its selection can easily bias the learning. We base our work on a popular method ODIN, proposing two strategies for freeing it from the needs of tuning with OoD data, while improving its OoD detection performance. We specifically propose to decompose confidence scoring as well as a modified input pre-processing method. We show that both of these significantly help in detection performance. Our further analysis on a larger scale image dataset shows that the two types of distribution shifts, specifically semantic shift and non-semantic shift, present a significant difference in the difficulty of the problem, providing an analysis of when ODIN-like strategies do or do not work.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The perturbation magnitude in G-ODIN is determined on a small held-out validation set.
“The perturbation magnitude is determined on a small held-out validation set.”
From QUTE: Quantifying Uncertainty in TinyML with Early-exit-assisted ensembles for model-monitoring (2024) · cites this paper as Hsu et al., 2020
Section 4.1 (page unavailable) says the classifier is trained on an in-distribution training set and the perturbation magnitude is then tuned on a separate in-distribution validation set. Section 3.2 (page unavailable) likewise says the magnitude is selected using only that validation set. The copy does not establish that the validation set is small. (LLM, conf=0.86)
Experimental — accuracy not yet measuredGeneral OOD-detectors are not automatically effective for CID detection.
“This suggests that general OOD-detectors are not automatically effective for CID detection”
From QUTE: Quantifying Uncertainty in TinyML with Early-exit-assisted ensembles for model-monitoring (2024) · cites this paper as Hsu et al., 2020
Section 4.3 (page unavailable) shows that OOD-detector performance varies by type of distribution shift and reports that Mahalanobis* performed worse than the baseline in most DomainNet cases. This supports the caution that general OOD detectors are not automatically effective, but the paper does not identify or evaluate CID detection specifically. (LLM, conf=0.79)
Experimental — accuracy not yet measuredG-ODIN is a generalized OOD detection method that decomposes the confidence score and introduces a preprocessing layer that perturbs inputs for better OOD detection.
“Generalized-ODIN (G-ODIN) (Hsu et al., 2020): a generalized OOD detection method that decomposes the confidence score and introduces a preprocessing layer that perturbs the inputs for better OOD detection.”
From QUTE: Quantifying Uncertainty in TinyML with Early-exit-assisted ensembles for model-monitoring (2024) · cites this paper as Hsu et al., 2020
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Densely Connected Convolutional Networks
Huang, G., Liu, Z., Van Der Maaten, L., & Weinberger, K. Q. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.243 · Cited by 48,566 · see citing works
Learning Multiple Layers of Features from Tiny Images
Krizhevsky, A. (2024) · doi:10.57702/zp44cu3g · Cited by 23,890 · see citing works
Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification
He, K., Zhang, X., Ren, S., & Sun, J. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.123 · Cited by 19,741 · see citing works
Distilling the Knowledge in a Neural Network
Hinton, G., Vinyals, O., & Dean, J. (2015) · arXiv · doi:10.48550/arxiv.1503.02531 · Cited by 14,204 · see citing works
Identity mappings in deep residual networks
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46493-0_38 · Cited by 10,741 · see citing works
Intriguing properties of neural networks
Szegedy, C., Zaremba, W., Sutskever, I., Bruna, J., Erhan, D., Goodfellow, I., & Fergus, R. (2013) · arXiv · doi:10.48550/arxiv.1312.6199 · Cited by 8,143 · see citing works
Zagoruyko, S., & Komodakis, N. (2016) · Procedings of the British Machine Vision Conference 2016 · doi:10.5244/c.30.87 · Cited by 7,244 · see citing works
Dropout as a bayesian approximation: Representing model uncertainty in deep learning
Gal, Y., & Ghahramani, Z. (2015) · arXiv · doi:10.48550/arxiv.1506.02142 · Cited by 6,471 · see citing works
Reading digits in natural images with unsupervised feature learning
Netzer, Y. (2024) · doi:10.57702/e7wwo0zk · Cited by 4,261 · see citing works
Simple and Scalable Predictive Uncertainty Estimation using Deep Ensembles
Lakshminarayanan, B., Pritzel, A., & Blundell, C. (2016) · arXiv · doi:10.48550/arxiv.1612.01474 · Cited by 3,666 · see citing works
On calibration of modern neural networks
Guo, C., Pleiss, G., Sun, Y., & Weinberger, K. Q. (2017) · arXiv · doi:10.48550/arxiv.1706.04599 · Cited by 3,435 · see citing works
Deep neural networks are easily fooled: High confidence predictions for unrecognizable images
Nguyen, A., Yosinski, J., & Clune, J. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298640 · Cited by 3,258 · see citing works
A Baseline for Detecting Misclassified and Out-of-Distribution Examples in Neural Networks
Hendrycks, D., & Gimpel, K. (2016) · arXiv · doi:10.48550/arxiv.1610.02136 · Cited by 1,968 · see citing works
Towards Open Set Deep Networks
Bendale, A., & Boult, T. E. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.173 · Cited by 1,799 · see citing works
Moment Matching for Multi-Source Domain Adaptation
Peng, X., Bai, Q., Xia, X., Huang, Z., Saenko, K., & Wang, B. (2019) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00149 · Cited by 1,731 · see citing works
A Simple Unified Framework for Detecting Out-of-Distribution Samples and Adversarial AttacksPreprint
Lee, K., Lee, K., Lee, H., & Shin, J. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1807.03888 · Cited by 1,166 · see citing works
Enhancing The Reliability of Out-of-distribution Image Detection in Neural NetworksPreprint
Liang, S., Li, Y., & Srikant, R. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1706.02690 · Cited by 1,117 · see citing works
Deep Anomaly Detection with Outlier Exposure
Hendrycks, D., Mazeika, M., & Dietterich, T. (2018) · arXiv · doi:10.48550/arxiv.1812.04606 · Cited by 932 · see citing works
Visual Domain Adaptation: A survey of recent advances
Patel, V. M., Gopalan, R., Li, R., & Chellappa, R. (2015) · IEEE Signal Processing Magazine · doi:10.1109/msp.2014.2347059 · Cited by 883 · see citing works
Salimans, T., Karpathy, A., Chen, X., & Kingma, D. P. (2017) · arXiv · doi:10.48550/arxiv.1701.05517 · Cited by 584 · see citing works
Towards Open World Recognition
Bendale, A., & Boult, T. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298799 · Cited by 529 · see citing works
Training Confidence-calibrated Classifiers for Detecting Out-of-Distribution SamplesPreprint
Lee, K., Lee, H., Lee, K., & Shin, J. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1711.09325 · Cited by 509 · see citing works
Predictive Uncertainty Estimation via Prior NetworksPreprint
Malinin, A., & Gales, M. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1802.10501 · Cited by 488 · see citing works
Enhancing the reliability of out-of-distribution image detection in neural networks
Liang, S. (2025) · TIB Data Manager · doi:10.57702/uwcm8hhf · Cited by 474 · see citing works
Likelihood Ratios for Out-of-Distribution DetectionPreprint
Ren, J., Liu, P. J., Fertig, E., Snoek, J., Poplin, R. E., DePristo, M. A., Dillon, J. V., & Lakshminarayanan, B. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1906.02845 · Cited by 407 · see citing works
Do Deep Generative Models Know What They Don't Know?Preprint
Nalisnick, E., Matsukawa, A., Teh, Y. W., Görür, D., & Lakshminarayanan, B. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1810.09136 · Cited by 372 · see citing works
Towards Open World Recognition
Bendale, A., & Boult, T. E. (2016) · Cited by 287 · see citing works
Reducing Network AgnostophobiaPreprint
Dhamija, A. R., Günther, M., & Boult, T. E. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1811.04110 · Cited by 251 · see citing works
AdaCos: Adaptively Scaling Cosine Logits for Effectively Learning Deep Face Representations
Zhang, X., Zhao, R., Qiao, Y., Wang, X., & Li, H. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.01108 · Cited by 251 · see citing works
Selective Classification for Deep Neural Networks
Geifman, Y., & El-Yaniv, R. (2017) · arXiv · doi:10.48550/arxiv.1705.08500 · Cited by 220 · see citing works
The Nearest Neighbor Classification Rule with a Reject Option
Hellman, M. E. (1970) · IEEE Transactions on Systems Science and Cybernetics · doi:10.1109/tssc.1970.300339 · Cited by 219 · see citing works
Out-of-Distribution Detection Using an Ensemble of Self Supervised Leave-Out Classifiers
Vyas, A., Jammalamadaka, N., Zhu, X., Das, D., Kaul, B., & Willke, T. L. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01237-3_34 · Cited by 205 · see citing works
Predictive Uncertainty Estimation via Prior Networks
Malinin, A., & Gales, M. (2018) · Apollo (University of Cambridge) · doi:10.17863/cam.35237 · Cited by 195 · see citing works
Ensemble Distribution DistillationPreprint
Gales, M., Malinin, A., & Mlodozeniec, B. (2019) · arXiv (Cornell University) · doi:10.17863/cam.49348 · Cited by 165 · see citing works
Cortes, C., DeSalvo, G., & Mohri, M. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-46379-7_5 · Cited by 162 · see citing works
Reverse KL-Divergence Training of Prior Networks: Improved Uncertainty and Adversarial RobustnessPreprint
Gales, M., & Malinin, A. (2019) · arXiv (Cornell University) · doi:10.17863/cam.45323 · Cited by 117 · see citing works
Transfer representation-learning for anomaly detection
Andrews, J. T. A., Tanay, T., Morton, E., & Griffin, L. D. (2016) · UCL Discovery (University College London) · Cited by 94 · see citing works
Out-of-Distribution Detection using Multiple Semantic Label RepresentationsPreprint
Shalev, G., Adi, Y., & Keshet, J. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1808.06664 · Cited by 65 · see citing works
Metric Learning for Novelty and Anomaly DetectionPreprint
Masana, M., Ruiz, I., Serrat, J., van de Weijer, J., & López, A. M. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1808.05492 · Cited by 63 · see citing works
Generative Ensembles for Robust Anomaly Detection
Choi, H., & Jang, E. (2018) · Cited by 51 · see citing works
Relaxed Softmax: Efficient Confidence Auto-Calibration for Safe Pedestrian Detection
Neumann, L., Zisserman, A., & Vedaldi, A. (2018) · Cited by 50 · see citing works
Hyperparameter-Free Out-of-Distribution Detection Using Softmax of Scaled Cosine SimilarityPreprint
Techapanurak, E., Suganuma, M., & Okatani, T. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1905.10628 · Cited by 18 · see citing works
Flagged first, then by citations
3 of the 45 references couldn’t be matched to a known paper.
Research works printed but not linked: 5
- Corinna Cortes, Giulia DeSalvo, and Mehryar Mohri. Learn- ing with rejection. In International Conference on Algorith- mic Learning Theory, pages 67-82. Springer, 2016.
- Gao Huang, Zhuang Liu, Laurens Van Der Maaten, and Kil- ian Q Weinberger. Densely connected convolutional net- works. In Proceedings of the IEEE conference on computer vision and pattern recognition, pages 4700-4708, 2017.
- Andrey Malinin, Bruno Mlodozeniec, and Mark Gales. En- semble distribution distillation. In International Conference on Learning Representations, 2019.
- Alireza Shafaei, Mark Schmidt, and James Little. A less biased evaluation of ood sample detectors. In Proceedings of the British Machine Vision Conference (BMVC), 2019.
- Sergey Zagoruyko and Nikos Komodakis. Wide residual net- works. arXiv preprint arXiv:1605.07146, 2016. · arXiv
Cited by
Sorted by citations
A survey of uncertainty in deep neural networks
Gawlikowski, J., Tassi, C. R. N., Ali, M., Lee, J., Humt, M., Feng, J., Kruspe, A., Triebel, R., Jung, P., Roscher, R., et al. (2023) · Artificial Intelligence Review · doi:10.1007/s10462-023-10562-9 · Cited by 1,525 · see citing works
Energy-based Out-of-distribution DetectionPreprint
Liu, W., Wang, X., Owens, J. D., & Li, Y. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.03759 · Cited by 694 · see citing works
Generalized Out-of-Distribution Detection: A Survey
Yang, J., Zhou, K., Li, Y., & Liu, Z. (2024) · International Journal of Computer Vision · doi:10.1007/s11263-024-02117-4 · Cited by 884 · see citing works
GAN-based anomaly detection: A review
Xia, X., Pan, X., Li, N., He, X., Ma, L., Zhang, X., & Ding, N. (2022) · Neurocomputing · doi:10.1016/j.neucom.2021.12.093 · Cited by 404 · see citing works
Adversarial Reciprocal Points Learning for Open Set Recognition
Chen, G., Peng, P., Wang, X., & Tian, Y. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2021.3106743 · Cited by 361 · see citing works
ViM: Out-Of-Distribution with Virtual-logit Matching
Wang, H., Li, Z., Feng, L., & Zhang, W. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.00487 · Cited by 309 · see citing works
Modeling the Distribution of Normal Data in Pre-Trained Deep Features for Anomaly Detection
Rippel, O., Mertens, P., & Merhof, D. (2021) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr48806.2021.9412109 · Cited by 280 · see citing works
A Survey of Uncertainty in Deep Neural Networks
Gawlikowski, J., Tassi, C. R. N., Ali, M., Lee, J., Humt, M., Feng, J., Kruspe, A., Triebel, R., Jung, P., Roscher, R., et al. (2021) · arXiv · doi:10.48550/arxiv.2107.03342 · Cited by 232 · see citing works
Open-Set Recognition: a Good Closed-Set Classifier is All You Need?Preprint
Vaze, S., Han, K., Vedaldi, A., & Zisserman, A. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2110.06207 · Cited by 257 · see citing works
Towards Open Vocabulary Learning: A Survey
Wu, J., Li, X., Xu, S., Yuan, H., Ding, H., Yang, Y., Li, X., Zhang, J., Tong, Y., Jiang, X., et al. (2024) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2024.3361862 · Cited by 191 · see citing works
MOS: Towards Scaling Out-of-distribution Detection for Large Semantic Space
Huang, R., & Li, Y. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.00860 · Cited by 167 · see citing works
DICE: Leveraging Sparsification for Out-of-Distribution Detection
Sun, Y., & Li, Y. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-20053-3_40 · Cited by 158 · see citing works
On the Importance of Gradients for Detecting Distributional Shifts in the WildPreprint
Huang, R., Geng, A., & Li, Y. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2110.00218 · Cited by 144 · see citing works
Machine learning with a reject option: A survey
Hendrickx, K., Perini, L., Van der Plas, D., Meert, W., & Davis, J. (2024) · Machine Learning · doi:10.1007/s10994-024-06534-x · Cited by 134 · see citing works
Chen, G., Peng, P., Ma, L., Li, J., Du, L., & Tian, Y. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00051 · Cited by 131 · see citing works
Zero-Shot Out-of-Distribution Detection Based on the Pre-trained Model CLIP
Esmaeilpour, S., Liu, B., Robertson, E., & Shu, L. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i6.20610 · Cited by 122 · see citing works
Detecting Out-of-Distribution Examples with Gram Matrices
Sastry, C. S., & Oore, S. (2020) · International Conference on Machine Learning · Cited by 110 · see citing works
Deep Deterministic Uncertainty: A New Simple Baseline
Mukhoti, J., Kirsch, A., van Amersfoort, J., Torr, P. H. S., & Gal, Y. (2023) · 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52729.2023.02336 · Cited by 116 · see citing works
Outlier exposure with confidence control for out-of-distribution detection
Papadopoulos, A.-A., Rajati, M. R., Shaikh, N., & Wang, J. (2021) · Neurocomputing · doi:10.1016/j.neucom.2021.02.007 · Cited by 100 · see citing works
GEN: Pushing the Limits of Softmax-Based Out-of-Distribution Detection
Liu, X., Lochman, Y., & Zach, C. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.02293 · Cited by 97 · see citing works
ATOM: Robustifying Out-of-Distribution Detection Using Outlier Mining
Chen, J., Li, Y., Wu, X., Liang, Y., & Jha, S. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-86523-8_26 · Cited by 94 · see citing works
Goodwin, A. E., Padmanabhan, S., Hira, S., Glancey, M., Slinowsky, M., Immidisetti, R., Scavo, L., Brey, J., Sudhakar, B. M. M. S., Ford, T., et al. (2021) · Scientific Reports · doi:10.1038/s41598-021-92891-9 · Cited by 88 · see citing works
Road Anomaly Detection by Partial Image Reconstruction with Segmentation Coupling
Vojir, T., Sipka, T., Aljundi, R., Chumerin, N., Reino, D. O., & Matas, J. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01536 · Cited by 87 · see citing works
MOOD: Multi-level Out-of-distribution Detection
Lin, Z., Roy, S. D., & Li, Y. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.01506 · Cited by 86 · see citing works
Rethinking Reconstruction Autoencoder-Based Out-of-Distribution Detection
Zhou, Y. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.00723 · Cited by 83 · see citing works
Unknown-Aware Object Detection: Learning What You Don't Know from Videos in the Wild
Du, X., Wang, X., Gozum, G., & Li, Y. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01331 · Cited by 80 · see citing works
Contrastive Out-of-Distribution Detection for Pretrained Transformers
Zhou, W., Liu, F., & Chen, M. (2021) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2021.emnlp-main.84 · Cited by 77 · see citing works
Iacucci, M., Santacroce, G., Zammarchi, I., Maeda, Y., Del Amor, R., Meseguer, P., Kolawole, B. B., Chaudhari, U., Di Sabatino, A., Danese, S., et al. (2024) · The Lancet Gastroenterology & Hepatology · doi:10.1016/s2468-1253(24)00053-0 · Cited by 73 · see citing works
Look Before You Leap: An Exploratory Study of Uncertainty Analysis for Large Language Models
Huang, Y., Song, J., Wang, Z., Zhao, S., Chen, H., Juefei-Xu, F., & Ma, L. (2025) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2024.3519464 · Cited by 132 · see citing works
Hyperparameter-Free Out-of-Distribution Detection Using Cosine Similarity
Techapanurak, E., Suganuma, M., & Okatani, T. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-69538-5_4 · Cited by 62 · see citing works
Difficulty-Aware Simulator for Open Set Recognition
Moon, W., Park, J., Seong, H. S., Cho, C.-H., & Heo, J. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-19806-9_21 · Cited by 62 · see citing works
Out-of-Distribution (OOD) Detection Based on Deep Learning: A Review
Cui, P., & Wang, J. (2022) · Electronics · doi:10.3390/electronics11213500 · Cited by 62 · see citing works
Learn to Forget: Machine Unlearning via Neuron Masking
Ma, Z., Liu, Y., Liu, X., Liu, J., Ma, J., & Ren, K. (2022) · IEEE Transactions on Dependable and Secure Computing · doi:10.1109/tdsc.2022.3194884 · Cited by 68 · see citing works
Towards Discovery and Attribution of Open-world GAN Generated Images
Girish, S., Suri, S., Rambhatla, S. S., & Shrivastava, A. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01383 · Cited by 58 · see citing works
Out-of-Distribution Detection Using Union of 1-Dimensional Subspaces
Zaeemzadeh, A., Bisagno, N., Sambugaro, Z., Conci, N., Rahnavard, N., & Shah, M. A. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.00933 · Cited by 56 · see citing works
Energy-Based Open-World Uncertainty Modeling for Confidence Calibration
Wang, Y., Li, B., Che, T., Zhou, K., Liu, Z., & Li, D. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00917 · Cited by 56 · see citing works
Anomaly Detection under Distribution Shift
Cao, T., Zhu, J., & Pang, G. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00599 · Cited by 56 · see citing works
Types of Out-of-Distribution Texts and How to Detect Them
Arora, U., Huang, W., & He, H. (2021) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2021.emnlp-main.835 · Cited by 54 · see citing works
A Survey on Learning to Reject
Zhang, X.-Y., Xie, G.-S., Li, X.-C., Mei, T., & Liu, C.-L. (2023) · Proceedings of the IEEE · doi:10.1109/jproc.2023.3238024 · Cited by 66 · see citing works
Decoupling MaxLogit for Out-of-Distribution Detection
Zhang, Z., & Xiang, X. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.00330 · Cited by 52 · see citing works
Koch, L. M., Baumgartner, C. F., & Berens, P. (2024) · npj Digital Medicine · doi:10.1038/s41746-024-01085-w · Cited by 53 · see citing works
Taxonomy of Machine Learning Safety: A Survey and Primer
Mohseni, S., Wang, H., Xiao, C., Yu, Z., Wang, Z., & Yadawa, J. (2023) · ACM Computing Surveys · doi:10.1145/3551385 · Cited by 53 · see citing works
Fang, X., Easwaran, A., Genest, B., & Suganthan, P. N. (2024) · Expert Systems with Applications · doi:10.1016/j.eswa.2024.126031 · Cited by 53 · see citing works
Can multi-label classification networks know what they don't know?Preprint
Wang, H., Liu, W., Bocchieri, A. E., & Li, Y. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2109.14162 · Cited by 49 · see citing works
Neural Mean Discrepancy for Efficient Out-of-Distribution Detection
Dong, X., Guo, J., Li, A., Ting, W.-T., Liu, C., & Kung, H. T. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01862 · Cited by 46 · see citing works
Mixture Outlier Exposure: Towards Out-of-Distribution Detection in Fine-grained Environments
Zhang, J., Inkawhich, N., Linderman, R., Chen, Y., & Li, H. H. (2023) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv56688.2023.00549 · Cited by 48 · see citing works
OpenMix+: Revisiting Data Augmentation for Open Set Recognition
Jiang, G., Zhu, P., Wang, Y., & Hu, Q. (2023) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2023.3268680 · Cited by 44 · see citing works
Making Reconstruction-based Method Great Again for Video Anomaly Detection
Wang, Y., Qin, C., Bai, Y., Xu, Y., Ma, X., & Fu, Y. (2022) · Proceedings · doi:10.1109/icdm54844.2022.00157 · Cited by 42 · see citing works
From Global to Local: Multi-Scale Out-of-Distribution Detection
Zhang, J., Gao, L., Hao, B., Huang, H., Song, J., & Shen, H. T. (2023) · IEEE Transactions on Image Processing · doi:10.1109/tip.2023.3328478 · Cited by 43 · see citing works
Memory-Efficient Semi-Supervised Continual Learning: The World is its Own Replay Buffer
Smith, J., Balloch, J., Hsu, Y.-C., & Kira, Z. (2021) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn52387.2021.9534361 · Cited by 40 · see citing works
Self-citationBlock Selection Method for Using Feature Norm in Out-of-Distribution Detection
Yu, Y., Shin, S., Lee, S., Jun, C., & Lee, K. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.01507 · Cited by 38 · see citing works
A Comprehensive Survey on Evidential Deep Learning and its Applications
Gao, J., Chen, M., Xiang, L., & Xu, C. (2025) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2025.3625258 · Cited by 38 · see citing works
Self-Checking Deep Neural Networks in Deployment
Xiao, Y., Beschastnikh, I., Rosenblum, D. S., Sun, C., Elbaum, S. G., Lin, Y., & Dong, J. S. (2021) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1109/icse43902.2021.00044 · Cited by 38 · see citing works
SAFE: Sensitivity-Aware Features for Out-of-Distribution Object Detection
Wilson, S., Fischer, T., Dayoub, F., Miller, D., & Sünderhauf, N. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.02154 · Cited by 38 · see citing works
Generative Classifiers as a Basis for Trustworthy Image Classification
Mackowiak, R., Ardizzone, L., Köthe, U., & Rother, C. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.00299 · Cited by 37 · see citing works
On the Impact of Spurious Correlation for Out-of-Distribution Detection
Ming, Y., Yin, H., & Li, Y. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i9.21244 · Cited by 37 · see citing works
Semi-supervised object detection with uncurated unlabeled data for remote sensing images
Liu, N., Xu, X., Gao, Y., Zhao, Y., & Li, H.-C. (2024) · International Journal of Applied Earth Observation and Geoinformation · doi:10.1016/j.jag.2024.103814 · Cited by 36 · see citing works
From Instance to Metric Calibration: A Unified Framework for Open-World Few-Shot Learning
An, Y., Xue, H., Zhao, X., & Wang, J. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2023.3244023 · Cited by 35 · see citing works
Uncertainty-Aware Fault Diagnosis Under Calibration
Lin, Y., & Li, G.-H. (2024) · IEEE Transactions on Systems Man and Cybernetics Systems · doi:10.1109/tsmc.2024.3427345 · Cited by 35 · see citing works
Fujisawa, T., Noguerales, V., Meramveliotakis, Ε., Papadopoulou, A., & Vogler, A. P. (2023) · Systematic Entomology · doi:10.1111/syen.12583 · Cited by 34 · see citing works
The familiarity hypothesis: Explaining the behavior of deep open set methods
Dietterich, T. G., & Guyer, A. (2022) · Pattern Recognition · doi:10.1016/j.patcog.2022.108931 · Cited by 34 · see citing works
CODEs: Chamfer Out-of-Distribution Examples against Overconfidence Issue
Tang, K., Miao, D., Peng, W., Wu, J., Shi, Y., Gu, Z., Tian, Z., & Wang, W. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00119 · Cited by 33 · see citing works
TIB: Detecting Unknown Objects via Two-Stream Information Bottleneck
Wu, A., & Deng, C. D. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2023.3323523 · Cited by 31 · see citing works
Yaseliani, M., Maghsoodi, A. I., Hassannayebi, E., & Aickelin, U. (2023) · Computers & Industrial Engineering · doi:10.1016/j.cie.2023.109754 · Cited by 33 · see citing works
Enhancing the generalization for Intent Classification and Out-of-Domain Detection in SLU
Shen, Y., Hsu, Y.-C., Ray, A., & Jin, H. (2021) · doi:10.18653/v1/2021.acl-long.190 · Cited by 33 · see citing works
Self-citationEntropic Out-of-Distribution Detection
Macêdo, D., Ren, T. I., Zanchettin, C., Oliveira, A. L. I., & Ludermir, T. (2021) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn52387.2021.9533899 · Cited by 30 · see citing works
Open-Set Semi-Supervised Object Detection
Liu, Y., Ma, C., Dai, X., Tian, J., Vajda, P., He, Z., & Kira, Z. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-20056-4_9 · Cited by 29 · see citing works
Self-citationOut-of-distribution Detection via Frequency-regularized Generative Models
Cai, M., & Li, Y. (2023) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv56688.2023.00548 · Cited by 29 · see citing works
Density of States Estimation for Out-of-Distribution DetectionPreprint
Morningstar, W. R., Ham, C., Gallagher, A., Lakshminarayanan, B., Alemi, A. A., & Dillon, J. V. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.09273 · Cited by 29 · see citing works
ID-like Prompt Learning for Few-Shot Out-of-Distribution Detection
Bai, Y., Han, Z., Cao, B., Jiang, X., Hu, Q., & Zhang, C. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01655 · Cited by 28 · see citing works
RD-OpenMax: Rethinking OpenMax for Robust Realistic Open-Set Recognition
Yin, X., Cao, B., Hu, Q., & Wang, Q. (2024) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2024.3394890 · Cited by 27 · see citing works
X-MAN: Explaining multiple sources of anomalies in video
Szymanowicz, S., Charles, J., & Cipolla, R. (2021) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw53098.2021.00360 · Cited by 27 · see citing works
OoD-Control: Generalizing Control in Unseen Environments
Ye, N., Zeng, Z., Zhou, J., Zhu, L., Duan, Y., Wu, Y., Wu, J., Zeng, H., Gu, Q., Wang, X., et al. (2024) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2024.3395484 · Cited by 27 · see citing works
Discrete neural representations for explainable anomaly detection
Szymanowicz, S., Charles, J., & Cipolla, R. (2022) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv51458.2022.00157 · Cited by 26 · see citing works
Entropic Out-of-Distribution Detection: Seamless Detection of Unknown Examples
Macêdo, D., Ren, T. I., Zanchettin, C., Oliveira, A. L. I., & Ludermir, T. B. (2021) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2021.3112897 · Cited by 25 · see citing works
Anomaly detection using Autoencoders and Deep Convolution Generative Adversarial Networks
Kopčan, J., Škvarek, O., & Klimo, M. (2021) · Transportation research procedia · doi:10.1016/j.trpro.2021.07.113 · Cited by 25 · see citing works
Generating Perturbation-based Explanations with Robustness to Out-of-Distribution Data
Qiu, L., Yang, Y., Cao, C. C., Zheng, Y., Ngai, H. H. T., Hsiao, J. H., & Chen, L. (2022) · International World Wide Web Conference (WWW) · doi:10.1145/3485447.3512254 · Cited by 25 · see citing works
Uncertainty-aware GAN with Adaptive Loss for Robust MRI Image Enhancement
Upadhyay, U., Sudarshan, V. P., & Awate, S. P. (2021) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw54120.2021.00364 · Cited by 25 · see citing works
What Does Rotation Prediction Tell Us about Classifier Accuracy under Varying Testing Environments?Preprint
Deng, W., Gould, S. J., & Zheng, L. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.05961 · Cited by 24 · see citing works
FedOSS: Federated Open Set Recognition via Inter-Client Discrepancy and Collaboration
Zhu, M., Liao, J., Liu, J., & Yuan, Y. (2023) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2023.3294014 · Cited by 23 · see citing works
Classification Under Human Assistance
De, A., Okati, N., Zarezade, A., & Gomez-Rodriguez, M. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i7.16738 · Cited by 7 · see citing works
Unsupervised Out-of-Distribution Object Detection via PCA-Driven Dynamic Prototype Enhancement
Wu, A., Deng, C. D., & Liu, W. (2024) · IEEE Transactions on Image Processing · doi:10.1109/tip.2024.3378464 · Cited by 23 · see citing works
Deep Neural Forest for Out-of-Distribution Detection of Skin Lesion Images
Li, X., Desrosiers, C., & Liu, X. (2022) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2022.3171582 · Cited by 23 · see citing works
Multi-Label Out-of-Distribution Detection Via Exploiting Sparsity and Co-Occurrence of Labels
Wang, L., Huang, S., Huangfu, L., Liu, B., & Zhang, X. (2022) · Image and Vision Computing · doi:10.1016/j.imavis.2022.104548 · Cited by 22 · see citing works
Yang, S., Abdel-Aty, M. A., Islam, Z., & Wang, D. (2024) · Accident Analysis & Prevention · doi:10.1016/j.aap.2024.107568 · Cited by 22 · see citing works
An Effective Baseline for Robustness to Distributional Shift
Thulasidasan, S., Thapa, S., Dhaubhadel, S., Chennupati, G., Bhattacharya, T., & Bilmes, J. (2021) · International Conference on Machine Learning and Applications · doi:10.1109/icmla52953.2021.00050 · Cited by 21 · see citing works
Enhancing out-of-distribution detection via diversified multi-prototype contrastive learning
Jia, Y., Li, J., Zhao, G., Liu, S., Sun, W., Lin, L., & Li, G. (2024) · Pattern Recognition · doi:10.1016/j.patcog.2024.111214 · Cited by 20 · see citing works
Hyperdimensional Feature Fusion for Out-of-Distribution Detection
Wilson, S., Fischer, T., Sünderhauf, N., & Dayoub, F. (2023) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv56688.2023.00267 · Cited by 20 · see citing works
Unifying Evaluation of Machine Learning Safety Monitors
Guerin, J. M., Ferreira, R., Delmas, K., & Guiochet, J. (2022) · Proceedings/Proceedings - International Symposium on Software Reliability Engineering · doi:10.1109/issre55969.2022.00047 · Cited by 20 · see citing works
Out-of-Distribution Detection for LiDAR-based 3D Object Detection
Huang, C., Nguyen, V. D., Abdelzad, V., Mannes, C. G., Rowe, L., Therien, B., Salay, R., & Czarnecki, K. (2022) · IEEE International Conference on Intelligent Transportation Systems (ITSC) · doi:10.1109/itsc55140.2022.9922026 · Cited by 20 · see citing works
Data-Efficient Learning via Minimizing Hyperspherical Energy
Cao, X., Liu, W., & Tsang, I. W.-H. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2023.3290544 · Cited by 20 · see citing works
Sun, Z., Qiu, Y., Tan, Z., Zheng, W., & Wang, R. (2024) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2024.3359319 · Cited by 20 · see citing works
Augmenting Softmax Information for Selective Classification with Out-of-Distribution Data
Xia, G., & Bouganis, C.-S. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-26351-4_40 · Cited by 19 · see citing works
Deep Feature Deblurring Diffusion for Detecting Out-of-Distribution Objects
Wu, A., Chen, D., & Deng, C. D. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01231 · Cited by 20 · see citing works
Understanding the Feature Norm for Out-of-Distribution Detection
Park, J., Chai, J. C. L., Yoon, J., & Teoh, A. B. J. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00150 · Cited by 19 · see citing works
Wang, H., Vaze, S., & Han, K. (2024) · International Journal of Computer Vision · doi:10.1007/s11263-024-02222-4 · Cited by 20 · see citing works
Detecting Out-of-distribution through the Lens of Neural Collapse
Liu, L., & Qin, Y. (2025) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52734.2025.01437 · Cited by 18 · see citing works
Xia, G., & Bouganis, C.-S. (2024) · International Journal of Computer Vision · doi:10.1007/s11263-024-02029-3 · Cited by 17 · see citing works
DiffGuard: Semantic Mismatch-Guided Out-of-Distribution Detection using Pre-trained Diffusion Models
Gao, R., Zhao, C., Hong, L., & Xu, Q. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00152 · Cited by 17 · see citing works
From Coarse to Fine-Grained Open-Set Recognition
Lang, N., Snæbjarnarson, V., Cole, E., Aodha, O. M., Igel, C., & Belongie, S. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01686 · Cited by 18 · see citing works
- Authors
- Hsu, Y.-C., Shen, Y., Jin, H., & Kira, Z.
- Affiliations
- Georgia Institute of Technology (US)
- Samsung (United States) (US)
- Venue
- 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
- Publisher
- IEEE
- Published
- 2020-06
- Pages
- 10948-10957
- ISSN
- 1063-6919 (ISSN-L)
- OpenAlex
- W3034230713
- Cited by
- 499
- References
- 45
- Citations by year
- 2026: 38 · 2025: 83 · 2024: 98 · 2023: 114 · 2022: 61 · 2021: 92 · 2020: 12 · 2019: 1
- FWCI
- 26.61
- Type
- conference paper
- Language
- en
- Open access
- green
- arxiv.org
- Licence
- Locations
- IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Adversarial Robustness in Machine Learning
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Digital Media Forensic Detection
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Keywords
- out-of-distribution detection, Odin, confidence calibration, distribution shift, semantic change, image classification, anomaly detection
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
