The DOI matches its Crossref record; 31 of the 31 references it cites were found in a registry or an index.
Learning from massive noisy labeled data for image classification
Abstract
Large-scale supervised datasets are crucial to train convolutional neural networks (CNNs) for various computer vision problems. However, obtaining a massive amount of well-labeled data is usually very expensive and time consuming. In this paper, we introduce a general framework to train CNNs with only a limited number of clean labels and millions of easily obtained noisy labels. We model the relationships between images, class labels and label noises with a probabilistic graphical model and further integrate it into an end-to-end deep learning system. To demonstrate the effectiveness of our approach, we collect a large-scale real-world clothing classification dataset with both noisy and clean labels. Experiments on this dataset indicate that our approach can better correct the noisy labels and improves the performance of trained CNNs.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
Going deeper with convolutions
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., & Rabinovich, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298594 · Cited by 48,562
Caffe: Convolutional Architecture for Fast Feature Embedding
Jia, Y., Shelhamer, E., Donahue, J., Karayev, S., Long, J., Girshick, R., Guadarrama, S., & Darrell, T. (2014) · Proceedings of the 22nd ACM international conference on Multimedia · doi:10.1145/2647868.2654889 · Cited by 11,077
DeCAF: A Deep Convolutional Activation Feature for Generic Visual Recognition
Donahue, J., Jia, Y., Vinyals, O., Hoffman, J., Zhang, N., Tzeng, E., & Darrell, T. (2013) · arXiv · doi:10.48550/arxiv.1310.1531 · Cited by 4,019
Learning and Transferring Mid-level Image Representations Using Convolutional Neural Networks
Oquab, M., Bottou, L., Laptev, I., & Sivic, J. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.222 · Cited by 3,150 · cited 2×
“Based on the observation of transferability of deep neural networks, people initialize parameters with a model pretrained on a larger yet related dataset [12], and then finetune on the smaller dataset of specific tasks [1,7,21].”
MethodLearning Hierarchical Features for Scene Labeling
Farabet, C., Couprie, C., Najman, L., & LeCun, Y. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2012.231 · Cited by 2,620
Classification in the Presence of Label Noise: A Survey
Frenay, B., & Verleysen, M. (2014) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2013.2292894 · Cited by 1,777
Learning from labeled and unlabeled data with label propagation
Zhu, X., & Ghahramani, Z. (2002) · Cited by 1,534
Convexity, Classification, and Risk Bounds
Bartlett, P. L., Jordan, M. I., & McAuliffe, J. D. (2006) · Journal of the American Statistical Association · doi:10.1198/016214505000000907 · Cited by 1,037
Class Noise vs. Attribute Noise: A Quantitative Study
Zhu, X., & Wu, X. (2004) · Artificial Intelligence Review · doi:10.1007/s10462-004-0751-8 · Cited by 893
Natarajan, N., Dhillon, I. S., Ravikumar, P., & Tewari, A. (2013) · Cited by 740
Identifying Mislabeled Training Data
Brodley, C. E., & Friedl, M. A. (1999) · Cited by 718
Identifying Mislabeled Training Data
Brodley, C. E., & Friedl, M. A. (1999) · Journal of Artificial Intelligence Research · doi:10.1613/jair.606 · Cited by 612
A Multi-View Embedding Space for Modeling Internet Images, Tags, and Their Semantics
Gong, Y., Ke, Q., Isard, M., & Lazebnik, S. (2014) · International Journal of Computer Vision · doi:10.1007/s11263-013-0658-4 · Cited by 540
Deep Learning via Semi-supervised Embedding
Weston, J., Ratle, F., Mobahi, H., & Collobert, R. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-35289-8_34 · Cited by 534
PANDA: Pose Aligned Networks for Deep Attribute Modeling
Zhang, N., Paluri, M., Ranzato, M., Darrell, T., & Bourdev, L. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.212 · Cited by 495
A study of the effect of different types of noise on the precision of supervised learning techniques
Nettleton, D. F., Orriols-Puig, A., & Fornells, A. (2010) · Artificial Intelligence Review · doi:10.1007/s10462-010-9156-z · Cited by 446
Visualizing and Understanding Convolutional Neural NetworksPreprint
Zeiler, M. D., & Fergus, R. (2013) · arXiv (Cornell University) · Cited by 442
Learning to Label Aerial Images from Noisy Data
Mnih, V., & Hinton, G. E. (2012) · International Conference on Machine Learning · Cited by 399
From generic to specific deep representations for visual recognition
Azizpour, H., Razavian, A. S., Sullivan, J., Maki, A., & Carlsson, S. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2015.7301270 · Cited by 394
Noise Tolerance Under Risk Minimization
Manwani, N., & Sastry, P. S. (2013) · IEEE Transactions on Cybernetics · doi:10.1109/tsmcb.2012.2223460 · Cited by 258
Class Noise and Supervised Learning in Medical Domains: The Effect of Feature Extraction
Pechenizkiy, M., Tsymbal, A., Puuronen, S. J., & Pechenizkiy, O. (2006) · Proceedings - IEEE Symposium on Computer-Based Medical Systems · doi:10.1109/cbms.2006.65 · Cited by 120
Learning with annotation noise
Beigman, E., & Klebanov, B. B. (2009) · doi:10.3115/1687878.1687919 · Cited by 93
Use of Classification Algorithms in Noise Detection and Elimination
Miranda, A., Garcia, L. P. F., de Carvalho, A. C. P. L. F., & Lorena, A. C. (2009) · Lecture notes in computer science · doi:10.1007/978-3-642-02319-4_50 · Cited by 82
Decontamination of Training Samples for Supervised Pattern Recognition Methods
Barandela, R., & Gasca, E. (2000) · Lecture notes in computer science · doi:10.1007/3-540-44522-6_64 · Cited by 81
Learning from Noisy Labels with Deep Neural NetworksPreprint
Sukhbaatar, S., & Fergus, R. (2014) · arXiv (Cornell University) · Cited by 64
A Comparison of Noise Handling Techniques
Teng, C.-M. (2001) · Cited by 53
Design of robust neural network classifiers
Larsen, J. O., Andersen, L. N., Hintz-Madsen, M., & Hansen, L. K. (2002) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.1998.675487 · Cited by 44
Computer aided cleaning of large databases for character recognition
Matic, N., Guyon, I., Bottou, L., Denker, J. S., & Vapnik, V. N. (2003) · IAPR International Conference on Pattern Recognition (ICPR) · doi:10.1109/icpr.1992.201784 · Cited by 36
Cited by
DeepFashion: Powering Robust Clothes Recognition and Retrieval with Rich Annotations
Liu, Z., Luo, P., Qiu, S., Wang, X., & Tang, X. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.124 · Cited by 1,803
Self-citationMaking Deep Neural Networks Robust to Label Noise: A Loss Correction Approach
Patrini, G., Rozza, A., Menon, A. K., Nock, R., & Qu, L. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.240 · Cited by 1,399
Learning From Noisy Labels With Deep Neural Networks: A Survey
Song, H., Kim, M., Park, D., Shin, Y., & Lee, J.-G. (2023) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2022.3152527 · Cited by 1,308
Concepts of Artificial Intelligence for Computer-Assisted Drug Discovery
Yang, X., Wang, Y., Byrne, R., Schneider, G., & Yang, S. (2019) · Chemical Reviews · doi:10.1021/acs.chemrev.8b00728 · Cited by 1,022
A Survey on Data Collection for Machine Learning: A Big Data - AI Integration Perspective
Roh, Y., Heo, G., & Whang, S. E. (2021) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2019.2946162 · Cited by 968
Metadata
- Authors
- Xiao, T., Xia, T., Yang, Y., Huang, C., & Wang, X.
- Venue
- 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
- Publisher
- IEEE
- Published
- 2015-06
- Pages
- 2691-2699
- ISSN
- 1063-6919 (ISSN-L)
- OpenAlex
- W1921293667
- Cited by
- 907
- References
- 31
- FWCI
- 20.26
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.