The DOI matches its Crossref record; 38 of the 38 references it cites were found in a registry or an index.
Making Deep Neural Networks Robust to Label Noise: A Loss Correction Approach
Open accessAbstract
We present a theoretically grounded approach to train deep neural networks, including recurrent networks, subject to class-dependent label noise. We propose two procedures for loss correction that are agnostic to both application domain and network architecture. They simply amount to at most a matrix inversion and multiplication, provided that we know the probability of each class being corrupted into another. We further show how one can estimate these probabilities, adapting a recent technique for noise estimation to the multi-class setting, and thus providing an end-to-end framework. Extensive experiments on MNIST, IMDB, CIFAR-10, CIFAR-100 and a large scale dataset of clothing images employing a diversity of architectures - stacking dense, convolutional, pooling, dropout, batch normalization, word embedding, LSTM and residual layers - demonstrate the noise robustness of our proposals. Incidentally, we also prove that, when ReLU is the only non-linearity, the loss curvature is immune to class-dependent label noise.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805
(2014) · Cited by 33,419
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
Ioffe, S., & Szegedy, C. (2015) · arXiv · doi:10.48550/arxiv.1502.03167 · Cited by 27,818
Learning Multiple Layers of Features from Tiny Images
Krizhevsky, A. (2024) · doi:10.57702/zp44cu3g · Cited by 23,395
Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification
He, K., Zhang, X., Ren, S., & Sun, J. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.123 · Cited by 19,741
(2010) · Cited by 14,134
Identity mappings in deep residual networks
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46493-0_38 · Cited by 10,741
Cited by
Generalized Cross Entropy Loss for Training Deep Neural Networks with Noisy Labels
Zhang, Z., & Sabuncu, M. R. (2018) · arXiv · doi:10.48550/arxiv.1805.07836 · Cited by 1,907
“Forward T and T̂ represent forward correction with the true and estimated confusion matrices, respectively [31].”
BackgroundMethodInfluentialTemporal Ensembling for Semi-Supervised Learning
Laine, S., & Aila, T. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1610.02242 · Cited by 1,395
Learning From Noisy Labels With Deep Neural Networks: A Survey
Song, H., Kim, M., Park, D., Shin, Y., & Lee, J.-G. (2023) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2022.3152527 · Cited by 1,308
Symmetric Cross Entropy for Robust Learning With Noisy Labels
Wang, Y., Ma, X., Chen, Z., Luo, Y., Yi, J., & Bailey, J. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00041 · Cited by 1,046
Robust Loss Functions under Label Noise for Deep Neural Networks
Ghosh, A., Kumar, H., & Sastry, P. S. (2017) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v31i1.10894 · Cited by 943
EEG-Based Emotion Recognition Using Regularized Graph Neural Networks
Zhong, P., Wang, D., & Miao, C. (2022) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2020.2994159 · Cited by 910
Confident Learning: Estimating Uncertainty in Dataset Labels
Northcutt, C., Jiang, L., & Chuang, I. (2021) · Journal of Artificial Intelligence Research · doi:10.1613/jair.1.12125 · Cited by 795
Joint Optimization Framework for Learning with Noisy Labels
Tanaka, D., Ikami, D., Yamasaki, T., & Aizawa, K. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00582 · Cited by 714
Deep learning with noisy labels: Exploring techniques and remedies in medical image analysis
Karimi, D., Dou, H., Warfield, S. K., & Gholipour, A. (2020) · Medical Image Analysis · doi:10.1016/j.media.2020.101759 · Cited by 706
Combating Noisy Labels by Agreement: A Joint Training Method with Co-Regularization
Wei, H., Feng, L., Chen, X., & An, B. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.01374 · Cited by 604
Zhong, J.-X., Li, N., Kong, W., Liu, S., Li, T. H., & Li, G. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00133 · Cited by 588
Data collection and quality challenges in deep learning: a data-centric AI perspective
Whang, S. E., Roh, Y., Song, H., & Lee, J.-G. (2023) · The VLDB Journal · doi:10.1007/s00778-022-00775-9 · Cited by 573
DivideMix: Learning with Noisy Labels as Semi-supervised Learning
Li, J., Socher, R., & Hoi, S. C. H. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2002.07394 · Cited by 500
CleanNet: Transfer Learning for Scalable Image Classifier Training with Label Noise
Lee, K.-H., He, X., Zhang, L., & Yang, L. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00571 · Cited by 478
Probabilistic End-To-End Noise Correction for Learning With Noisy Labels
Yi, K., & Wu, J. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00718 · Cited by 454
Meta-Weight-Net: Learning an Explicit Mapping For Sample Weighting
Shu, J., Xie, Q., Yi, L., Zhao, Q., Zhou, S., Xu, Z., & Meng, D. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1902.07379 · Cited by 385
Ge, Y., Chen, D., & Li, H. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2001.01526 · Cited by 370
Image classification with deep learning in the presence of noisy labels: A survey
Algan, G., & Ulusoy, I. (2021) · Knowledge-Based Systems · doi:10.1016/j.knosys.2021.106771 · Cited by 337
Learning to Learn From Noisy Labeled Data
Li, J., Wong, Y., Zhao, Q., & Kankanhalli, M. S. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00519 · Cited by 324
Iterative Learning with Open-set Noisy Labels
Wang, Y., Liu, W., Ma, X., Bailey, J., Zha, H., Song, L., & Xia, S.-T. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00906 · Cited by 324
CurriculumNet: Weakly Supervised Learning from Large-Scale Web Images
Guo, S., Huang, W., Zhang, H., Zhuang, C., Dong, D., Scott, M. R., & Huang, D. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01249-6_9 · Cited by 319
Deep Self-Learning From Noisy Labels
Han, J., Luo, P., & Wang, X. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00524 · Cited by 313
NLNL: Negative Learning for Noisy Labels
Kim, Y., Yim, J., Yun, J., & Kim, J. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00019 · Cited by 305
Part-based Pseudo Label Refinement for Unsupervised Person Re-identification
Cho, Y., Kim, W. J., Hong, S., & Yoon, S.-E. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.00716 · Cited by 305
Pervasive label errors in test sets destabilize machine learning benchmarks
Northcutt, C. G., Athalye, A., & Mueller, J. (2021) · arXiv · doi:10.48550/arxiv.2103.14749 · Cited by 293
A Robust Learning Approach to Domain Adaptive Object Detection
Khodabandeh, M., Vahdat, A., Ranjbar, M., & Macready, W. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00057 · Cited by 274
A Comprehensive Survey on Poisoning Attacks and Countermeasures in Machine Learning
Tian, Z., Cui, L., Liang, J., & Yu, S. (2023) · ACM Computing Surveys · doi:10.1145/3551636 · Cited by 271
O2U-Net: A Simple Noisy Label Detection Approach for Deep Neural Networks
Huang, J., Qu, L., Jia, R., & Zhao, B. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00342 · Cited by 261
Self-citationAdversarial Label-Flipping Attack and Defense for Graph Neural Networks
Zhang, M., Hu, L., Shi, C., & Wang, X. (2020) · 2020 IEEE International Conference on Data Mining (ICDM) · doi:10.1109/icdm50108.2020.00088 · Cited by 74
Towards Federated Learning against Noisy Labels via Local Self-Regularization
Jiang, X., Sun, S., Wang, Y., & Liu, M. (2022) · Proceedings of the 31st ACM International Conference on Information & Knowledge Management · doi:10.1145/3511808.3557475 · Cited by 65
Effects of Label Noise on Deep Learning-Based Skin Cancer Classification
Hekler, A., Kather, J. N., Krieghoff-Henning, E., Utikal, J. S., Meier, F., Gellrich, F. F., Upmeier zu Belzen, J., French, L., Schlager, J. G., Ghoreschi, K., et al. (2020) · Frontiers in Medicine · doi:10.3389/fmed.2020.00177 · Cited by 58
Confidence Scores Make Instance-dependent Label-noise Learning Possible
Berthon, A., Han, B., Niu, G., Liu, T., & Sugiyama, M. (2020) · arXiv · doi:10.48550/arxiv.2001.03772 · Cited by 57
Training Binary Neural Networks through Learning with Noisy Supervision
Han, K., Wang, Y., Xu, Y., Xu, C., Wu, E., & Xu, C. (2020) · arXiv · doi:10.48550/arxiv.2010.04871 · Cited by 36
Sample Specific Generalized Cross Entropy for Robust Histology Image Classification
Kurian, N. C., Meshram, P. S., Patil, A., Patel, S., & Sethi, A. (2021) · 2021 IEEE 18th International Symposium on Biomedical Imaging (ISBI) · doi:10.1109/isbi48211.2021.9434169 · Cited by 19
Exploring the Robustness of In-Context Learning with Noisy Labels
Cheng, C., Yu, X., Wen, H., Sun, J., Yue, G., Zhang, Y., & Wei, Z. (2025) · ICASSP 2025 - 2025 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp49660.2025.10889281 · Cited by 11
Losses over Labels: Weakly Supervised Learning via Direct Loss Construction
Sam, D., & Kolter, J. Z. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i8.26159 · Cited by 6
Not All Samples are Trustworthy: Towards Deep Robust SVP Prediction
Xu, Q., Yang, Z., Jiang, Y., Cao, X., Yao, Y., & Huang, Q. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2020.3047817 · Cited by 6
Metadata
- Authors
- Patrini, G., Rozza, A., Menon, A. K., Nock, R., & Qu, L.
- Venue
- 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
- Publisher
- IEEE
- Published
- 2017-07
- Pages
- 2233-2241
- ISSN
- 1063-6919 (ISSN-L)
- OpenAlex
- W2964292098
- Cited by
- 1,399
- References
- 38
- FWCI
- 40.27
- Type
- conference paper
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.