CoChat
Sign Up
PreprintCited by 211Adversarial Robustness in Machine LearningAdvanced Neural Network ApplicationsMachine Learning and Data Classification

The DOI matches its DataCite record; 5 of the 5 references it cites were found in a registry or an index.

Addressing Failure Prediction by Learning Model Confidence

Open access
Corbière, Charles, Thome, Nicolas, Bar-Hen, Avner, Cord, Matthieu, Pérez, Patrick·2019·arXiv
DOI 10.48550/arxiv.1910.04851arXiv 1910.04851
Open this paper in CoChat — free accountOpen PDF

Abstract

Assessing reliably the confidence of a deep neural network and predicting its failures is of primary importance for the practical deployment of these models. In this paper, we propose a new target criterion for model confidence, corresponding to the True Class Probability (TCP). We show how using the TCP is more suited than relying on the classic Maximum Class Probability (MCP). We provide in addition theoretical guarantees for TCP in the context of failure prediction. Since the true class is by essence unknown at test time, we propose to learn TCP criterion on the training set, introducing a specific learning scheme adapted to this context. Extensive experiments are conducted for validating the relevance of the proposed approach. We study various network architectures, small and large scale datasets for image classification and semantic segmentation. We show that our approach consistently outperforms several strong methods, from MCP to Bayesian uncertainty, as well as recent approaches specifically designed for failure prediction.

Overview

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

DataCite · 10.48550/arxiv.1910.04851

Cites

5 of 5 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • UQ in traditional machine learning algorithms has extensively been studied using different ensemble techniques and few more UQ methods [232] or some other UQ methods in classification problems [233].

    “It is worthwhile noting that UQ in traditional machine learning algorithms have extensively been studied using different ensemble techniques and few more UQ methods (e.g. please see [232]) or some other UQ methods in classification problems [233] in the literature.”

    From A review of uncertainty quantification in deep learning: Techniques, applications and challenges (2021) · cites this paper as [233]

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Flagged first, then by citations

Research works printed but not linked: 35

  1. Dario Amodei, Chris Olah, Jacob Steinhardt, Paul F. Christiano, John Schulman, and Dan Mané. Concrete problems in AI safety. arXiv preprint arXiv:1606.06565, 2016. 1 · arXiv
  2. John Blatz, Erin Fitzgerald, George Foster, Simona Gandrabur, Cyril Goutte, Alex Kulesza, Alberto Sanchis, and Nicola Ueffing. Confidence estimation for machine translation. In COLING, 2004. 5
  3. Charles Blundell, Julien Cornebise, Koray Kavukcuoglu, and Daan Wierstra. Weight uncertainty in neural networks. In ICML, 2015. 5
  4. Gabriel J. Brostow, Julien Fauqueur, and Roberto Cipolla. Semantic object classes in video: A high-definition ground truth database. Pattern Recogn. Lett., 30(2):88-97, 2009.
  5. Terrance DeVries and Graham W Taylor. Learning confidence for out-of-distribution detection in neural networks. arXiv preprint arXiv:1802.04865, 2018. 5 · arXiv
  6. Thibaut Durand, Nicolas Thome, and Matthieu Cord. Mantra: Minimum maximum latent structural SVM for image classification and ranking. In ICCV, 2015. 4
  7. Yarin Gal. Uncertainty in Deep Learning. PhD thesis, University of Cambridge, 2016. 5
  8. Yonatan Geifman and Ran El-Yaniv. Selective classification for deep neural networks. In NIPS, 2017. 5, 8
  9. Ian J Goodfellow, Jonathon Shlens, and Christian Szegedy. Explaining and harnessing adversar- ial examples. arXiv preprint arXiv:1412.6572, 2014. 2 · arXiv
  10. Ligong Han, Yang Zou, Ruijiang Gao, Lezi Wang, and Dimitris Metaxas. Unsupervised domain adaptation via calibrating uncertainties. In CVPR Workshops, 2019. 9
  11. Awni Hannun, Carl Case, Jared Casper, Bryan Catanzaro, Greg Diamos, Erich Elsen, Ryan Prenger, Sanjeev Satheesh, Shubho Sengupta, Adam Coates, and Andrew Y. Ng. Deep speech: Scaling up end-to-end speech recognition. arXiv preprint arXiv:1412.5567, 2014. 1 · arXiv
  12. Dan Hendrycks and Kevin Gimpel. A baseline for detecting misclassified and out-of-distribution examples in neural networks. In ICLR, 2017. 1, 2, 5, 6, 7
  13. Geoffrey Hinton, Li Deng, Dong Yu, George E Dahl, Abdel-rahman Mohamed, Navdeep Jaitly, Andrew Senior, Vincent Vanhoucke, Patrick Nguyen, Tara N Sainath, et al. Deep neural networks for acoustic modeling in speech recognition: The shared views of four research groups. IEEE Signal Processing Magazine, 29(6):82-97, 2012. 1
  14. Joel Janai, Fatma Güney, Aseem Behl, and Andreas Geiger. Computer vision for au- tonomous vehicles: Problems, datasets and state-of-the-art. arXiv preprint arXiv:1704.05519, abs/1704.05519, 2017. 1 · arXiv
  15. Heinrich Jiang, Been Kim, Melody Guan, and Maya Gupta. To trust or not to trust a classifier. In NIPS, 2018. 1, 2, 5, 6, 7
  16. Alex Kendall, Vijay Badrinarayanan, , and Roberto Cipolla. Bayesian SegNet: Model un- certainty in deep convolutional encoder-decoder architectures for scene understanding. arXiv preprint arXiv:1511.02680, 2015. 5, 6 · arXiv
  17. Alex Kendall and Yarin Gal. What uncertainties do we need in Bayesian deep learning for computer vision? In NIPS, 2017. 5
  18. Alex Kendall, Yarin Gal, and Roberto Cipolla. Multi-task learning using uncertainty to weigh losses for scene geometry and semantics. In CVPR, June 2018. 9
  19. A. Krizhevsky and G. Hinton. Learning multiple layers of features from tiny images. Master's thesis, Department of Computer Science, University of Toronto, 2009. 6
  20. Balaji Lakshminarayanan, Alexander Pritzel, and Charles Blundell. Simple and scalable predictive uncertainty estimation using deep ensembles. In Advances in Neural Information Processing Systems 30, 2017. 2, 5, 6
  21. Kimin Lee, Honglak Lee, Kibok Lee, and Jinwoo Shin. Training confidence-calibrated classifiers for detecting out-of-distribution samples. In ICLR, 2018. 5
  22. Qiujia Li, Preben Ness, Anton Ragni, and M.J.F. Gales. Bi-directional lattice recurrent neural networks for confidence estimation. In IEEE International Conference on Acoustics, Speech and Signal Processing, 10 2018. 5
  23. Shiyu Liang, Yixuan Li, and R. Srikant. Enhancing the reliability of out-of-distribution image detection in neural networks. In ICLR, 2018. 2, 5
  24. T. Lin, P. Goyal, R. Girshick, K. He, and P. Dollár. Focal loss for dense object detection. In ICCV, 2017. 4
  25. Wei Liu, Dragomir Anguelov, Dumitru Erhan, Christian Szegedy, Scott Reed, Cheng-Yang Fu, and Alexander C. Berg. SSD: Single shot multibox detector. In ECCV, 2016. 1
  26. Pritish Mohapatra, Michal Rolínek, C.V. Jawahar, Vladimir Kolmogorov, and M. Pawan Kumar. Efficient optimization for rank-based loss functions. In CVPR, June 2018. 4
  27. Taylor Mordan, Nicolas Thome, Gilles Henaff, and Matthieu Cord. End-to-end learning of latent deformable part-based representations for object detection. International Journal of Computer Vision, pages 1-21, 07 2018. 1
  28. Taylor Mordan, Nicolas Thome, Gilles Henaff, and Matthieu Cord. Revisiting multi-task learning with ROCK: a deep residual auxiliary block for visual detection. In NIPS, 2018. 9
  29. Yuval Netzer, Tao Wang, Adam Coates, Alessandro Bissacco, Bo Wu, and Andrew Y. Ng. Reading digits in natural images with unsupervised feature learning. In NIPS Workshop, 2011. 6
  30. L. Neumann, A. Zisserman, and A. Vedaldi. Relaxed softmax: Efficient confidence auto- calibration for safe pedestrian detection. In NIPS Workshops, 2018. 2, 5
  31. Anh Mai Nguyen, Jason Yosinski, and Jeff Clune. Deep neural networks are easily fooled: High confidence predictions for unrecognizable images. In CVPR, 2015. 2
  32. A. Ragni, Q. Li, M. J. F. Gales, and Y. Wang. Confidence estimation and deletion prediction using bidirectional recurrent neural networks. In SLT Workshop, 2018. 5
  33. Shaoqing Ren, Kaiming He, Ross Girshick, and Jian Sun. Faster R-CNN: Towards real-time object detection with region proposal networks. In NIPS, 2015. 1
  34. Christian Szegedy, Wojciech Zaremba, Ilya Sutskever, Joan Bruna, Dumitru Erhan, Ian J. Goodfellow, and Rob Fergus. Intriguing properties of neural networks. In ICLR, 2014. 2
  35. Tuan-Hung Vu, Himalaya Jain, Maxime Bucher, Matthieu Cord, and Patrick Pérez. ADVENT: Adversarial entropy minimization for domain adaptation in semantic segmentation. In CVPR, 2019.

Cited by

Sorted by citations

Metadata

Authors
Corbière, C., Thome, N., Bar-Hen, A., Cord, M., & Pérez, P.
Affiliations
  • Centre d'études et de recherche en informatique et communications (FR)
  • Conservatoire National des Arts et Métiers (FR)
  • Valeo (France) (FR)
ORCID
Venue
arXiv
Publisher
arXiv
Published
2019
Pages
2898-2909
ISSN
2331-8422 (ISSN-L)
DOI
10.48550/arxiv.1910.04851
arXiv
1910.04851
OpenAlex
W2970565181
Cited by
211
References
5
Citations by year
2026: 3 · 2025: 24 · 2024: 33 · 2023: 46 · 2022: 43 · 2021: 42 · 2020: 18 · 2019: 1
Type
posted content
Language
en
Open access
Licence
arxiv.org/licenses/nonexclusive-distrib/1.0/
Locations
  • arXiv (Cornell University) (submittedVersion)
  • HAL (submittedVersion, other-oa)
  • arXiv (Cornell University)
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Adversarial Robustness in Machine Learning
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
  • Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning and Data Classification
Keywords
failure prediction, model confidence, deep neural network, confidence calibration, uncertainty estimation, Bayesian uncertainty, image classification, semantic segmentation, theoretical guarantees

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review