The DOI matches its Crossref record; 39 of the 39 references it cites were found in a registry or an index.
Combating Noisy Labels by Agreement: A Joint Training Method with Co-Regularization
Open accessAbstract
Deep Learning with noisy labels is a practically challenging problem in weakly-supervised learning. The state-of-the-art approaches "Decoupling" and "Co-teaching+" claim that the "disagreement" strategy is crucial for alleviating the problem of learning with noisy labels. In this paper, we start from a different perspective and propose a robust learning paradigm called JoCoR, which aims to reduce the diversity of two networks during training. Specifically, we first use two networks to make predictions on the same mini-batch data and calculate a joint loss with Co-Regularization for each training example. Then we select small-loss examples to update the parameters of both two networks simultaneously. Trained by the joint loss, these two networks would be more and more similar due to the effect of Co-Regularization. Extensive experimental results on corrupted data from benchmark datasets including MNIST, CIFAR-10, CIFAR-100 and Clothing1M demonstrate that JoCoR is superior to many state-of-the-art approaches for learning with noisy labels.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Combining labeled and unlabeled data with co-training
Blum, A., & Mitchell, T. (1998) · Proceedings of the eleventh annual conference on Computational learning theory · doi:10.1145/279943.279962 · Cited by 5,495
(2006) · The MIT Press eBooks · doi:10.7551/mitpress/9780262033589.001.0001 · Cited by 4,280
Training Region-Based Object Detectors with Online Hard Example Mining
Shrivastava, A., Gupta, A., & Girshick, R. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.89 · Cited by 2,686
Generalized Cross Entropy Loss for Training Deep Neural Networks with Noisy Labels
Zhang, Z., & Sabuncu, M. R. (2018) · arXiv · doi:10.48550/arxiv.1805.07836 · Cited by 1,907
A brief introduction to weakly supervised learning
Zhou, Z.-H. (2018) · National Science Review · doi:10.1093/nsr/nwx106 · Cited by 1,899
Zhang, Y., Xiang, T., Hospedales, T. M., & Lu, H. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00454 · Cited by 1,752
Making Deep Neural Networks Robust to Label Noise: A Loss Correction Approach
Patrini, G., Rozza, A., Menon, A. K., Nock, R., & Qu, L. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.240 · Cited by 1,399
Co-teaching: Robust Training of Deep Neural Networks with Extremely Noisy Labels
Han, B., Yao, Q., Yu, X., Niu, G., Xu, M., Hu, W., Tsang, I. W.-H., & Sugiyama, M. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1804.06872 · Cited by 1,347
A Closer Look at Memorization in Deep Networks
Arpit, D., Jastrzębski, S., Ballas, N., Krueger, D., Bengio, E., Kanwal, M. S., Maharaj, T., Fischer, A., Courville, A., Bengio, Y., et al. (2017) · arXiv · doi:10.48550/arxiv.1706.05394 · Cited by 1,307
Learning from massive noisy labeled data for image classification
Xiao, T., Xia, T., Yang, Y., Huang, C., & Wang, X. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298885 · Cited by 907
Classification with Noisy Labels by Importance Reweighting
Liu, T., & Tao, D. (2016) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2015.2456899 · Cited by 782
Natarajan, N., Dhillon, I. S., Ravikumar, P., & Tewari, A. (2013) · Cited by 740
Learning to Reweight Examples for Robust Deep Learning
Ren, M., Zeng, W., Yang, B., & Urtasun, R. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1803.09050 · Cited by 740
Joint Optimization Framework for Learning with Noisy Labels
Tanaka, D., Ikami, D., Yamasaki, T., & Aizawa, K. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00582 · Cited by 714
Training Deep Neural Networks on Noisy Labels with Bootstrapping
Reed, S., Lee, H., Anguelov, D., Szegedy, C., Erhan, D., & Rabinovich, A. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1412.6596 · Cited by 667
Noise-tolerant learning, the parity problem, and the statistical query model
Blum, A., Kalai, A., & Wasserman, H. (2003) · Journal of the ACM · doi:10.1145/792538.792543 · Cited by 598
Training deep neural-networks using a noise adaptation layer
Goldberger, J., & Ben-Reuven, E. (2017) · International Conference on Learning Representations · Cited by 579
MentorNet: Learning Data-Driven Curriculum for Very Deep Neural Networks on Corrupted Labels
Jiang, L., Zhou, Z., Leung, T., Li, L.-J., & Fei-Fei, L. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1712.05055 · Cited by 503
Probabilistic End-To-End Noise Correction for Learning With Noisy Labels
Yi, K., & Wu, J. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00718 · Cited by 454
Generalized cross entropy loss for training deep neural networks with noisy labelsPreprint
Zhang, Z., & Sabuncu, M. R. (2018) · arXiv (Cornell University) · Cited by 439
Decoupling "when to update" from "how to update"Preprint
Malach, E., & Shalev‐Shwartz, S. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1706.02613 · Cited by 394
A Co-Regularization Approach to Semi-supervised Learning with Multiple Views
Sindhwani, V., Niyogi, P., & Belkin, M. (2005) · Cited by 378
MentorNet: Learning Data-Driven Curriculum for Very Deep Neural Networks on Corrupted Labels
Jiang, L., Zhou, Z., Leung, T., Li, L.-J., & Fei-Fei, L. (2018) · International Conference on Machine Learning · Cited by 371
Learning to Learn From Noisy Labeled Data
Li, J., Wong, Y., Zhao, Q., & Kankanhalli, M. S. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00519 · Cited by 324
Deep Self-Learning From Noisy Labels
Han, J., Luo, P., & Wang, X. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00524 · Cited by 313
NLNL: Negative Learning for Noisy Labels
Kim, Y., Yim, J., Yun, J., & Kim, J. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00019 · Cited by 305
Analysis of Learning from Positive and Unlabeled Data
du Plessis, M. C., Niu, G., & Sugiyama, M. (2014) · neural information processing systems · Cited by 266
Learning from multiple annotators with varying expertise
Yan, Y., Rosales, R., Fung, G., Subramanian, R., & Dy, J. (2014) · Machine Learning · doi:10.1007/s10994-013-5412-1 · Cited by 191
Learning with Biased Complementary Labels
Yu, X., Liu, T., Gong, M., & Tao, D. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01246-5_5 · Cited by 175
Co-regularization Based Semi-supervised Domain Adaptation
Kumar, A., Saha, A., & Daumé, H. (2010) · neural information processing systems · Cited by 146
Learning from Corrupted Binary Labels via Class-Probability Estimation
Menon, A. K., van Rooyen, B., Ong, C. S., & Williamson, B. (2015) · ANU Open Research (Australian National University) · Cited by 135
Theoretical Comparisons of Positive-Unlabeled Learning against Positive-Negative LearningPreprint
Niu, G., du Plessis, M. C., Sakai, T., Ma, Y., & Sugiyama, M. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1603.03130 · Cited by 82
Semi-Supervised Classification Based on Classification from Positive and Unlabeled DataPreprint
Sakai, T., du Plessis, M. C., Niu, G., & Sugiyama, M. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1605.06955 · Cited by 76
On the Minimal Supervision for Training Any Binary Classifier from Only Unlabeled DataPreprint
Lu, N., Niu, G., Menon, A. K., & Sugiyama, M. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1808.10585 · Cited by 66
Binary Classification from Positive-Confidence DataPreprint
Ishida, T., Niu, G., & Sugiyama, M. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1710.07138 · Cited by 44
Niu, G., Jitkrittum, W., Dai, B., et al. (2013) · Cited by 41
Learning with Inadequate and Incorrect Supervision
Gong, C., Zhang, H., Yang, J. J., & Tao, D. (2017) · Proceedings · doi:10.1109/icdm.2017.110 · Cited by 40
Class Proportion Estimation with Application to Multiclass Anomaly RejectionPreprint
Sanderson, T., & Scott, C. D. (2013) · arXiv (Cornell University) · doi:10.48550/arxiv.1306.5056 · Cited by 36
Cited by
Learning From Noisy Labels With Deep Neural Networks: A Survey
Song, H., Kim, M., Park, D., Shin, Y., & Lee, J.-G. (2023) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2022.3152527 · Cited by 1,308
Avoiding Overfitting: A Survey on Regularization Methods for Convolutional Neural Networks
Santos, C. F. G. D., & Papa, J. P. (2022) · ACM Computing Surveys · doi:10.1145/3510413 · Cited by 557
“JoCoR [63] trains two similar neural networks on the same data set and tries to correlate two different labels.”
BackgroundRahate, A., Walambe, R., Ramanna, S., & Kotecha, K. (2022) · Information Fusion · doi:10.1016/j.inffus.2021.12.003 · Cited by 214
Multimodal data integration for oncology in the era of deep neural networks: a review
Waqas, A., Tripathi, A., Ramachandran, R. P., Stewart, P. A., & Rasool, G. (2024) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2024.1408843 · Cited by 165
Taxonomy of Machine Learning Safety: A Survey and Primer
Mohseni, S., Wang, H., Xiao, C., Yu, Z., Wang, Z., & Yadawa, J. (2023) · ACM Computing Surveys · doi:10.1145/3551385 · Cited by 53
Metadata
- Authors
- Wei, H., Feng, L., Chen, X., & An, B.
- Venue
- 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
- Publisher
- IEEE
- Published
- 2020-06
- Pages
- 13723-13732
- ISSN
- 1063-6919 (ISSN-L)
- OpenAlex
- W3034185248
- Cited by
- 604
- References
- 39
- FWCI
- 30.14
- Type
- conference paper
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.