An Empirical Evaluation on Robustness and Uncertainty of Regularization Methods
Open accessAbstract
Despite apparent human-level performances of deep neural networks (DNN), they behave fundamentally differently from humans. They easily change predictions when small corruptions such as blur and noise are applied on the input (lack of robustness), and they often produce confident predictions on out-of-distribution samples (improper uncertainty measure). While a number of researches have aimed to address those issues, proposed solutions are typically expensive and complicated (e.g. Bayesian inference and adversarial training). Meanwhile, many simple and cheap regularization methods have been developed to enhance the generalization of classifiers. Such regularization methods have largely been overlooked as baselines for addressing the robustness and uncertainty issues, as they are not specifically designed for that. In this paper, we provide extensive empirical evaluations on the robustness and uncertainty estimates of image classifiers (CIFAR-100 and ImageNet) trained with state-of-the-art regularization methods. Furthermore, experimental results show that certain regularization methods can serve as strong baseline methods for robustness and uncertainty estimation of DNNs.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
There are a limited number of studies on quantifying uncertainties in GNNs/GCNs.
“Our findings reveal that even though Bayesian-based GNNs/GCNs (Graph Convolutional Networks) [280], [593], [594], [595] and Deep graph BO [596] have shown promising outcomes for quantifying uncertainties in GNNs/GCNs, but there are a limited number of studies in this research domain.”
From A review of uncertainty quantification in deep learning: Techniques, applications and challenges (2021) · cites this paper as [594]
The Introduction (pp. 1–2) discusses uncertainty estimation in DNNs and says the effects of certain regularization techniques have rarely been investigated. The paper’s stated experiments concern image classifiers, not GNNs or GCNs. Searches for graph neural networks, graph convolutional networks, and Bayesian graph uncertainty found no passage addressing how many studies quantify uncertainty in GNNs/GCNs. (LLM, conf=0.76)
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474 · see citing works
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155 · see citing works
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946 · see citing works
Densely Connected Convolutional Networks
Huang, G., Liu, Z., Van Der Maaten, L., & Weinberger, K. Q. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.243 · Cited by 48,566 · see citing works
Squeeze-and-Excitation Networks
Hu, J., Shen, L., & Sun, G. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00745 · Cited by 35,667 · see citing works
(2014) · Cited by 33,419 · see citing works
Rethinking the Inception Architecture for Computer Vision
Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J., & Wojna, Z. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.308 · Cited by 32,138 · see citing works
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
Ioffe, S., & Szegedy, C. (2015) · arXiv · doi:10.48550/arxiv.1502.03167 · Cited by 27,818 · see citing works
Unsupervised representation learning with deep convolutional generative adversarial networks
Radford, A., Metz, L., & Chintala, S. (2015) · arXiv · doi:10.48550/arxiv.1511.06434 · Cited by 12,235 · see citing works
Dropout as a bayesian approximation: Representing model uncertainty in deep learning
Gal, Y., & Ghahramani, Z. (2015) · arXiv · doi:10.48550/arxiv.1506.02142 · Cited by 6,471 · see citing works
mixup: Beyond Empirical Risk Minimization
Zhang, H., Cisse, M., Dauphin, Y. N., & Lopez-Paz, D. (2017) · arXiv · doi:10.48550/arxiv.1710.09412 · Cited by 5,831 · see citing works
CutMix: Regularization Strategy to Train Strong Classifiers With Localizable Features
Yun, S., Han, D., Chun, S., Oh, S. J., Yoo, Y., & Choe, J. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00612 · Cited by 5,400 · see citing works
Self-citationInception-v4, Inception-ResNet and the Impact of Residual Connections on Learning
Szegedy, C., Ioffe, S., Vanhoucke, V., & Alemi, A. (2017) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v31i1.11231 · Cited by 4,636 · see citing works
Random Erasing Data Augmentation
Zhong, Z., Zheng, L., Kang, G., Li, S., & Yang, Y. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i07.7000 · Cited by 3,617 · see citing works
On calibration of modern neural networks
Guo, C., Pleiss, G., Sun, Y., & Weinberger, K. Q. (2017) · arXiv · doi:10.48550/arxiv.1706.04599 · Cited by 3,435 · see citing works
What Uncertainties Do We Need in Bayesian Deep Learning for Computer Vision?
Kendall, A., & Gal, Y. (2017) · arXiv · doi:10.48550/arxiv.1703.04977 · Cited by 3,088 · see citing works
Improved regularization of convolutional neural networks with cutout
DeVries, T., & Taylor, G. W. (2017) · arXiv · doi:10.48550/arxiv.1708.04552 · Cited by 2,776 · see citing works
Adversarial machine learning at scale
Kurakin, A., Goodfellow, I., & Bengio, S. (2016) · arXiv · doi:10.48550/arxiv.1611.01236 · Cited by 2,325 · see citing works
Deep Networks with Stochastic Depth
Huang, G., Sun, Y., Liu, Z., Sedra, D., & Weinberger, K. Q. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46493-0_39 · Cited by 2,104 · see citing works
A Baseline for Detecting Misclassified and Out-of-Distribution Examples in Neural Networks
Hendrycks, D., & Gimpel, K. (2016) · arXiv · doi:10.48550/arxiv.1610.02136 · Cited by 1,968 · see citing works
LSUN: Construction of a Large-scale Image Dataset using Deep Learning with Humans in the LoopPreprint
Yu, F., Seff, A., Zhang, Y., Song, S., Funkhouser, T., & Xiao, J. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1506.03365 · Cited by 1,339 · see citing works
Robustness May Be at Odds with AccuracyPreprint
Tsipras, D., Santurkar, S., Engstrom, L., Turner, A., & Mądry, A. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1805.12152 · Cited by 1,240 · see citing works
AutoAugment: Learning Augmentation Policies from Data
Cubuk, E. D., Zoph, B., Mane, D., Vasudevan, V., & Le, Q. V. (2018) · arXiv · doi:10.48550/arxiv.1805.09501 · Cited by 1,106 · see citing works
Feature denoising for improving adversarial robustness
Xie, C., Wu, Y., Maaten, L. V. D., Yuille, A. L., & He, K. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00059 · Cited by 940 · see citing works
Deep Pyramidal Residual Networks
Han, D., Kim, J., & Kim, J. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.668 · Cited by 715 · see citing works
Self-citationGather-Excite: Exploiting Feature Context in Convolutional Neural NetworksPreprint
Hu, J., Shen, L., Albanie, S., Sun, G., & Vedaldi, A. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1810.12348 · Cited by 574 · see citing works
Training Confidence-calibrated Classifiers for Detecting Out-of-Distribution SamplesPreprint
Lee, K., Lee, H., Lee, K., & Shin, J. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1711.09325 · Cited by 509 · see citing works
DropBlock: A regularization method for convolutional networksPreprint
Ghiasi, G., Lin, T.-Y., & Le, Q. V. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1810.12890 · Cited by 509 · see citing works
Generalisation in humans and deep neural networksPreprint
Geirhos, R., Temme, C. R. M., Rauber, J., Schütt, H. H., Bethge, M., & Wichmann, F. A. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1808.08750 · Cited by 498 · see citing works
Enhancing the reliability of out-of-distribution image detection in neural networks
Liang, S. (2025) · TIB Data Manager · doi:10.57702/uwcm8hhf · Cited by 474 · see citing works
Adversarial Logit PairingPreprint
Boyle, E., Kurakin, A., & Vaikuntanathan, V. (2018) · arXiv (Cornell University) · doi:10.4230/lipics.itcs.2019.16 · Cited by 434 · see citing works
Shake-Shake regularizationPreprint
Gastaldi, X. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1705.07485 · Cited by 353 · see citing works
Shakedrop Regularization for Deep Residual Learning
Yamada, Y., Iwamura, M., Akiba, T., & Kise, K. (2019) · IEEE Access · doi:10.1109/access.2019.2960566 · Cited by 173 · see citing works
NSML: Meet the MLaaS platform with a real-world case study
Kim, H., Kim, M., Seo, D., Kim, J., Park, H., Park, S., Jo, H., Kim, K., Yang, Y., Kim, Y., et al. (2018) · arXiv · doi:10.48550/arxiv.1810.09957 · Cited by 91 · see citing works
NSML: A Machine Learning Platform That Enables You to Focus on Your ModelsPreprint
Sung, N., Kim, M., Jo, H., Yang, Y., Kim, J., Lausen, L., Kim, Y., Lee, G., Kwak, D., Ha, J.-W., et al. (2017) · arXiv.org · doi:10.48550/arxiv.1712.05902 · Cited by 88 · see citing works
Attacking the Madry Defense Model with $L_1$-based Adversarial ExamplesPreprint
Sharma, Y., & Chen, P. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1710.10733 · Cited by 77 · see citing works
Flagged first, then by citations
6 of the 42 references couldn’t be matched to a known paper.
Research works printed but not linked: 7
- Geirhos, R., Rubisch, P., Michaelis, C., Bethge, M., Wichmann, F. A., and Brendel, W. Imagenet-trained cnns are biased towards texture; increasing shape bias improves accuracy and robustness. arXiv preprint arXiv:1811.12231 , 2018a. · arXiv
- Goodfellow, I. J., Shlens, J., and Szegedy, C. Explaining and harnessing adversarial examples. In International Conference on Learning Representations , 2015.
- Gulrajani, I., Ahmed, F., Arjovsky, M., Dumoulin, V., and Courville, A. C. Improved training of wasserstein gans. In Advances in Neural Information Processing Systems , pp. 5767-5777, 2017.
- Hendrycks, D. and Dietterich, T. Benchmarking neural network robustness to common corruptions and perturbations. In International Conference on Learning Representations , 2019. URL https://openreview.net/ forum?id=HJz6tiCqYm .
- Lakshminarayanan, B., Pritzel, A., and Blundell, C. Simple and scalable predictive uncertainty estimation using deep ensembles. In Guyon, I., Luxburg, U. V., Bengio, S., Wallach, H., Fergus, R., Vishwanathan, S., and Garnett, R. (eds.), Advances in Neural Information Processing Systems 30 , pp. 6402-6413. Curran Associates, Inc., 2017.
- Madry, A., Makelov, A., Schmidt, L., Tsipras, D., and Vladu, A. Towards deep learning models resistant to adversarial attacks. arXiv preprint arXiv:1706.06083 , 2017. · arXiv
- Szegedy, C., Zaremba, W., Sutskever, I., Bruna, J., Erhan, D., Goodfellow, I., and Fergus, R. Intriguing properties of neural networks. arXiv preprint arXiv:1312.6199 , 2013. · arXiv
Cited by
Sorted by citations
A review of uncertainty quantification in deep learning: Techniques, applications and challenges
Abdar, M., Pourpanah, F., Hussain, S., Rezazadegan, D., Liu, L., Ghavamzadeh, M., Fieguth, P., Cao, X., Khosravi, A., Acharya, U. R., et al. (2021) · Information Fusion · doi:10.1016/j.inffus.2021.05.008 · Cited by 2,720 · see citing works
“[342] (Regularization Method), Mehta et al.”
AugMix: A Simple Data Processing Method to Improve Robustness and UncertaintyPreprint
Hendrycks, D., Mu, N., Cubuk, E. D., Zoph, B., Gilmer, J., & Lakshminarayanan, B. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1912.02781 · Cited by 893 · see citing works
Self-Knowledge Distillation with Progressive Refinement of Targets
Kim, K., Ji, B., Yoon, D., & Hwang, S. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00650 · Cited by 268 · see citing works
(2020) · International Conference on Learning Representations · Cited by 168 · see citing works
Few-shot Font Generation with Localized Style Representations and Factorization
Park, S., Chun, S., Cha, J., Lee, B., & Shim, H. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i3.16340 · Cited by 117 · see citing works
Self-citationPixMix: Dreamlike Pictures Comprehensively Improve Safety Measures
Hendrycks, D., Zou, A., Mazeika, M., Tang, L., Li, B., Song, D. X., & Steinhardt, J. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01628 · Cited by 112 · see citing works
AdamP: Slowing Down the Slowdown for Momentum Optimizers on Scale-invariant WeightsPreprint
Heo, B., Chun, S., Oh, S. J., Han, D., Yun, S., Kim, G., Uh, Y., & Ha, J.-W. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.08217 · Cited by 133 · see citing works
Self-citationEvaluating Prediction-Time Batch Normalization for Robustness under Covariate ShiftPreprint
Nado, Z., Padhy, S., Sculley, D., D'Amour, A., Lakshminarayanan, B., & Snoek, J. (2020) · arXiv.org · doi:10.48550/arxiv.2006.10963 · Cited by 357 · see citing works
Mixture Outlier Exposure: Towards Out-of-Distribution Detection in Fine-grained Environments
Zhang, J., Inkawhich, N., Linderman, R., Chen, Y., & Li, H. H. (2023) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv56688.2023.00549 · Cited by 48 · see citing works
On the Effect of Pruning on Adversarial Robustness
Jordão, A., & Pedrini, H. (2021) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw54120.2021.00007 · Cited by 23 · see citing works
Few-Shot Font Generation With Weakly Supervised Localized Representations
Park, S., Chun, S., Cha, J., Lee, B., & Shim, H. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2022.3196675 · Cited by 23 · see citing works
Self-citationExploring Robustness Connection between Artificial and Natural Adversarial Examples
Agarwal, A., Ratha, N., Mayank Vatsa, A., & Singh, R. (2022) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw56347.2022.00030 · Cited by 12 · see citing works
Studying the Impact of Augmentations on Medical Confidence Calibration
Rao, A., Lee, J., & Aalami, O. (2023) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw60793.2023.00260 · Cited by 10 · see citing works
Effects of mixed sample data augmentation on interpretability of neural networks
Won, S., Bae, S., & Kim, S. T. (2025) · Neural Networks · doi:10.1016/j.neunet.2025.107611 · Cited by 8 · see citing works
Diverse Gaussian Noise Consistency Regularization for Robustness and Uncertainty Calibration
Tsiligkaridis, T., & Tsiligkaridis, A. (2023) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn54540.2023.10191763 · Cited by 9 · see citing works
SeiT: Storage-Efficient Vision Training with Tokens Using 1% of Pixel Storage
Park, S., Chun, S., Heo, B., Kim, W., & Yun, S. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01582 · Cited by 7 · see citing works
Self-citationImproved Robustness to Open Set Inputs via Tempered Mixup
Roady, R., Hayes, T. L., & Kanan, C. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-66415-2_12 · Cited by 3 · see citing works
Chun, S., & Park, S. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2108.10549 · Cited by 3 · see citing works
Self-citationObservations on K-Image Expansion of Image-Mixing Augmentation
Jeong, J., Cha, S., Choi, J., Yun, S., Moon, T., & Yoo, Y. (2023) · IEEE Access · doi:10.1109/access.2023.3243108 · Cited by 2 · see citing works
Self-citationRobustness of Deep Learning Methods for Ocular Fundus Segmentation: Evaluation of Blur Sensitivity
Petrović, V. B., Gojić, G., Драган, Д., GAJIĆ, D. B., Horvat, N., Turović, R., & Oros, A. (2020) · International Conference on Innovations in Intelligent Systems and Applications (INISTA) · doi:10.1109/inista49547.2020.9194612 · Cited by 2 · see citing works
Narayanaswamy, V., Anirudh, R., & Thiagarajan, J. J. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10445865 · Cited by 1 · see citing works
PWPROP: A Progressive Weighted Adaptive Method for Training Deep Neural Networks
Wang, D., Xu, T., Zhang, H., Shang, F., Liu, H., Liu, Y., & Shen, S. (2022) · IEEE International Conference on Tools with Artificial Intelligence (ICTAI) · doi:10.1109/ictai56018.2022.00081 · Cited by 1 · see citing works
From Game Theory to Visual Recognition: Advancing DNN Robustness
Liu, Z., Jiang, W., Guo, M., & Wang, C. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10446404 · Cited by 1 · see citing works
A Robustness Assessment Approach for Hardware Noise-Based Convolutional Neural Networks
Xie, X., Sun, B., & Li, J. (2024) · International Conference on Computer and Communication Systems (ICCCS) · doi:10.1109/icccs61882.2024.10603190 · Cited by 1 · see citing works
The Dilemma Between Dimensionality Reduction and Adversarial Robustness.Preprint
Alemany, S., & Pissinou, N. (2020) · arXiv (Cornell University) · Cited by 1 · see citing works
Dabke, Y., Gadgil, G., Dabke, V., & Gadgil, D. G. (2023) · doi:10.36227/techrxiv.24208722.v3 · Cited by 1 · see citing works
Misclassification-Aware Gaussian Smoothing improves Robustness against Domain ShiftsPreprint
Tsiligkaridis, A., & Tsiligkaridis, T. (2021) · arXiv (Cornell University)
Learning from Matured Dumb Teacher for Fine GeneralizationPreprint
Jung, H., Kim, K., Kim, H., & Shin, J.-H. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2108.05776
Tsiligkaridis, A., & Tsiligkaridis, T. (2021) · arXiv (Cornell University)
Frustratingly Easy Uncertainty Estimation for Distribution ShiftPreprint
Salvador, T., Voleti, V., Iannantuono, A., & Oberman, A. M. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.03762
On the Effects of Data Distortion on Model Analysis and TrainingPreprint
Marcu, A., & Prügel‐Bennett, A. (2021) · arXiv (Cornell University)
Mixture Outlier Exposure for Out-of-Distribution Detection in Fine-grained Settings.Preprint
Zhang, J., Inkawhich, N., Linderman, R., Chen, Y., & Li, H. H. (2021) · arXiv (Cornell University)
Enhancing Multiple Reliability Measures via Nuisance-Extended Information Bottleneck
Jeong, J., Yu, S., Lee, H., & Shin, J. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.01555
Dabke, Y., Gadgil, G., & Dabke, V. (2023) · doi:10.36227/techrxiv.24208722
Dabke, Y., Gadgil, G., Dabke, V., & Gadgil, G. (2023) · doi:10.36227/techrxiv.24208722.v2
VF-Net: Robustness Via Understanding Distortions and Transformations
Amerehi, F., & Healy, P. J. (2024) · Proceedings - International Conference on Image Processing · doi:10.1109/icip51287.2024.10647346
A Systematic Review on Applications of Deep Learning in Supply Chain Risk Management
Vankayalapati, R. H., & Banerjee, A. (2026) · Operations Research Forum · doi:10.1007/s43069-026-00682-7 · Cited by 1 · see citing works
- Authors
- Chun, S., Oh, S. J., Yun, S., Han, D., Choe, J., & Yoo, Y.
- Affiliations
- Naver (South Korea) (KR)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2020
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 2003.03879
- OpenAlex
- W3009090315
- Cited by
- 37
- References
- 42
- Citations by year
- 2026: 1 · 2025: 1 · 2024: 4 · 2023: 9 · 2022: 4 · 2021: 11 · 2020: 6 · 2019: 1
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Adversarial Robustness in Machine Learning
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning and Data Classification
- Keywords
- regularization methods, robustness, uncertainty estimation, adversarial robustness, out-of-distribution generalization, image classifiers, deep neural network, CIFAR-100, ImageNet, noise robustness
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
