The DOI matches its Crossref record; 69 of the 69 references it cites were found in a registry or an index.
Deep Imbalanced Learning for Face Recognition and Attribute Prediction
Open accessAbstract
Data for face analysis often exhibit highly-skewed class distribution, i.e., most data belong to a few majority classes, while the minority classes only contain a scarce amount of instances. To mitigate this issue, contemporary deep learning methods typically follow classic strategies such as class re-sampling or cost-sensitive training. In this paper, we conduct extensive and systematic experiments to validate the effectiveness of these classic schemes for representation learning on class-imbalanced data. We further demonstrate that more discriminative deep representation can be learned by enforcing a deep network to maintain inter-cluster margins both within and between classes. This tight constraint effectively reduces the class imbalance inherent in the local data neighborhood, thus carving much more balanced class boundaries locally. We show that it is easy to deploy angular margins between the cluster distributions on a hypersphere manifold. Such learned Cluster-based Large Margin Local Embedding (CLMLE), when combined with a simple k-nearest cluster algorithm, shows significant improvements in accuracy over existing methods on both face recognition and face attribute prediction tasks that exhibit imbalanced class distribution.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
ImageNet Large Scale Visual Recognition Challenge
Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., Bernstein, M., et al. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-015-0816-y · Cited by 39,380
(2008) · Journal of Machine Learning Research · Cited by 33,051
SMOTE synthetic minority over-sampling technique
Chawla, N. V., Bowyer, K. W., Hall, L. O., & Kegelmeyer, W. P. (2002) · Journal of Artificial Intelligence Research · doi:10.1613/jair.953 · Cited by 32,865
Learning Multiple Layers of Features from Tiny Images
Krizhevsky, A. (2024) · doi:10.57702/zp44cu3g · Cited by 23,395
FaceNet: A unified embedding for face recognition and clustering
Schroff, F., Kalenichenko, D., & Philbin, J. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298682 · Cited by 15,267
He, H., & Garcia, E. A. (2009) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2008.239 · Cited by 10,359
Deep Learning Face Attributes in the Wild
Liu, Z., Luo, P., Wang, X., & Tang, X. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.425 · Cited by 7,747
Self-citationDeepFace: Closing the Gap to Human-Level Performance in Face Verification
Taigman, Y., Yang, M., Ranzato, M., & Wolf, L. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.220 · Cited by 6,542
Joint Face Detection and Alignment Using Multitask Cascaded Convolutional Networks
Zhang, K., Zhang, Z., Li, Z., & Qiao, Y. (2016) · IEEE Signal Processing Letters · doi:10.1109/lsp.2016.2603342 · Cited by 6,214
Parkhi, O. M., Vedaldi, A., & Zisserman, A. (2015) · Procedings of the British Machine Vision Conference 2015 · doi:10.5244/c.29.41 · Cited by 5,479
Labeled Faces in the Wild: A Database forStudying Face Recognition in Unconstrained Environments
Huang, G. B., Mattar, M., Berg, T. L., & Miller, E. G. (2008) · HAL · Cited by 4,822
ADASYN: Adaptive synthetic sampling approach for imbalanced learning
He, H., Bai, Y., Garcia, E. A., & Li, S. (2008) · 2008 IEEE International Joint Conference on Neural Networks (IEEE World Congress on Computational Intelligence) · doi:10.1109/ijcnn.2008.4633969 · Cited by 4,521
Borderline-SMOTE : A New Over-Sampling Method in Imbalanced Data Sets Learning
Han, H., Wang, W.-Y., & Mao, B.-H. (2005) · Lecture notes in computer science · doi:10.1007/11538059_91 · Cited by 4,331
A Discriminative Feature Learning Approach for Deep Face Recognition
Wen, Y., Zhang, K., Li, Z., & Qiao, Y. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46478-7_31 · Cited by 4,077
Learning and Transferring Mid-level Image Representations Using Convolutional Neural Networks
Oquab, M., Bottou, L., Laptev, I., & Sivic, J. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.222 · Cited by 3,150 · cited 1×
“[17] resampled the number of foreground and background image patches for learning a convolutional neural network (CNN) for object classification.”
CosFace: Large Margin Cosine Loss for Deep Face Recognition
Wang, H., Wang, Y., Zhou, Z., Ji, X., Gong, D., Zhou, J., Li, Z., & Liu, W. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00552 · Cited by 3,034
Eigen, D., & Fergus, R. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.304 · Cited by 2,862
Why Does Unsupervised Pre-training Help Deep Learning?
Erhan, D., Bengio, Y., Courville, A. C., Manzagol, P.-A., Vincent, P., & Samy Bengio, A. (2010) · Journal of Machine Learning Research · Cited by 2,573
SphereFace: Deep Hypersphere Embedding for Face Recognition
Liu, W., Wen, Y., Yu, Z., Li, M., Raj, B., & Song, L. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.713 · Cited by 2,280
Deep Learning Face Representation by Joint Identification-Verification
Sun, Y., Wang, X., & Tang, X. (2014) · arXiv · doi:10.48550/arxiv.1406.4773 · Cited by 1,906
Self-citation(2016) · neural information processing systems · Cited by 1,572
Learning Face Representation from Scratch
Yi, D., Lei, Z., Liao, S., & Li, S. Z. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1411.7923 · Cited by 1,521
Face recognition in unconstrained videos with matched background similarity
Wolf, L., Hassner, T., & Maoz, I. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995566 · Cited by 1,382
Training cost-sensitive neural networks with methods addressing the class imbalance problem
Zhou, Z.-H., & Liu, X.-Y. (2006) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2006.17 · Cited by 1,326
Learning Fine-Grained Image Similarity with Deep Ranking
Wang, J., Song, Y., Leung, T., Rosenberg, C., Wang, J., Philbin, J., Chen, B., & Wu, Y. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.180 · Cited by 1,269
An empirical evaluation of deep architectures on problems with many factors of variation
Larochelle, H., Erhan, D., Courville, A., Bergstra, J., & Bengio, Y. (2007) · Proceedings of the 24th international conference on Machine learning · doi:10.1145/1273496.1273556 · Cited by 992
Learning Deep Representation for Imbalanced Classification
Huang, C., Li, Y., Loy, C. C., & Tang, X. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.580 · Cited by 988
Self-citationCost-Sensitive Learning of Deep Feature Representations From Imbalanced Data
Khan, S. H., Hayat, M., Bennamoun, M., Sohel, F. A., & Togneri, R. (2018) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2017.2732482 · Cited by 967
SVMs Modeling for Highly Imbalanced Classification
Tang, Y., Zhang, Y.-Q., Chawla, N. V., & Krasser, S. (2009) · IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics) · doi:10.1109/tsmcb.2008.2002909 · Cited by 966
Deeply learned face representations are sparse, selective, and robust
Sun, Y., Wang, X., & Tang, X. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298907 · Cited by 939
Self-citationThe MegaFace Benchmark: 1 Million Faces for Recognition at Scale
Kemelmacher-Shlizerman, I., Seitz, S. M., Miller, D., & Brossard, E. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.527 · Cited by 912
Imbalanced Learning: Foundations, Algorithms, and Applications
(2013) · Wiley eBooks · doi:10.1002/9781118646106 · Cited by 831
C4.5, Class Imbalance, and Cost Sensitivity: Why Under-Sampling beats Over-Sampling
Drummond, C., & Holte, R. C. (2003) · Cited by 799
Learning to Reweight Examples for Robust Deep Learning
Ren, M., Zeng, W., Yang, B., & Urtasun, R. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1803.09050 · Cited by 740
Optimised KD-trees for fast image descriptor matching
Silpa-Anan, C., & Hartley, R. (2008) · 2008 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2008.4587638 · Cited by 677
DeepContour: A deep convolutional feature learned by positive-sharing loss for contour detection
Shen, W., Wang, X., Wang, Y., Bai, X., & Zhang, Z. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7299024 · Cited by 515
PANDA: Pose Aligned Networks for Deep Attribute Modeling
Zhang, N., Paluri, M., Ranzato, M., Darrell, T., & Bourdev, L. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.212 · Cited by 495
Training deep neural networks on imbalanced data sets
Wang, S., Liu, W., Wu, J., Cao, L., Meng, Q., & Kennedy, P. J. (2016) · 2016 International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2016.7727770 · Cited by 491
Feedforward semantic segmentation with zoom-out features
Mostajabi, M., Yadollahpour, P., & Shakhnarovich, G. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298959 · Cited by 436
Describable Visual Attributes for Face Verification and Image Search
Kumar, N., Berg, A., Belhumeur, P. N., & Nayar, S. (2011) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2011.48 · Cited by 434
Distance-Based Image Classification: Generalizing to New Classes at Near-Zero Cost
Mensink, T., Verbeek, J., Perronnin, F., & Csurka, G. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2013.83 · Cited by 431
Range Loss for Deep Face Recognition with Long-Tailed Training Data
Zhang, X., Fang, Z., Wen, Y., Li, Z., & Qiao, Y. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.578 · Cited by 405
Berg, T., & Belhumeur, P. N. (2013) · 2013 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2013.128 · Cited by 372
Cost-sensitive decision tree ensembles for effective imbalanced classification
Krawczyk, B., Woźniak, M., & Schaefer, G. (2014) · Applied Soft Computing · doi:10.1016/j.asoc.2013.08.014 · Cited by 361
ON MULTI‐CLASS COST‐SENSITIVE LEARNING
Zhou, Z., & Liu, X. (2010) · Computational Intelligence · doi:10.1111/j.1467-8640.2010.00358.x · Cited by 350
Do We Really Need to Collect Millions of Faces for Effective Face Recognition?
Masi, I., Trần, A. T., Hassner, T., Leksut, J. T., & Medioni, G. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46454-1_35 · Cited by 339
A Comparative Study of Cost-Sensitive Boosting Algorithms
Ting, K. M. (2000) · Cited by 262
Local neighbourhood extension of SMOTE for mining imbalanced data
Maciejewski, T., & Stefanowski, J. (2011) · 2011 IEEE Symposium on Computational Intelligence and Data Mining (CIDM) · doi:10.1109/cidm.2011.5949434 · Cited by 255
Novel Cost-Sensitive Approach to Improve the Multilayer Perceptron Performance on Imbalanced Data
Castro, C. L., & Braga, A. P. (2013) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2013.2246188 · Cited by 235
Web-scale training for face identification
Taigman, Y., Yang, M., Ranzato, M., & Wolf, L. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298891 · Cited by 227
Targeting Ultimate Accuracy: Face Recognition via Deep Embedding
Liu, J., Deng, Y., Bai, T., Wei, Z., & Huang, C. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1506.07310 · Cited by 223
Self-citationMarginal Loss for Deep Face Recognition
Deng, J., Zhou, Y., & Zafeiriou, S. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2017.251 · Cited by 218
MOON: A Mixed Objective Optimization Network for the Recognition of Facial Attributes
Rudd, E. M., Günther, M., & Boult, T. E. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-46454-1_2 · Cited by 203
Class Rectification Hard Mining for Imbalanced Deep Learning
Dong, Q., Gong, S., & Zhu, X. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.205 · Cited by 189
Classification of Imbalanced Data by Combining the Complementary Neural Network and SMOTE Algorithm
Jeatrakul, P., Wong, K. W., & Fung, C. C. (2010) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-17534-3_19 · Cited by 185
Level Playing Field for Million Scale Face Recognition
Nech, A., & Kemelmacher-Shlizerman, I. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.363 · Cited by 180
Chen, B., Deng, W., & Du, J. (2017) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2017.428 · Cited by 164
Loss Max-Pooling for Semantic Image Segmentation
Bulò, S. R., Neuhold, G., & Kontschieder, P. (2017) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2017.749 · Cited by 163
Rethinking Feature Discrimination and Polymerization for Large-scale RecognitionPreprint
Liu, Y., Li, H., & Wang, X. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1710.00870 · Cited by 138
Local Similarity-Aware Deep Feature EmbeddingPreprint
Huang, C., Loy, C. C., & Tang, X. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1610.08904 · Cited by 131
Self-citationOne-shot Face Recognition by Promoting Underrepresented ClassesPreprint
Guo, Y., & Zhang, L. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1707.05574 · Cited by 125
Dual autoencoders features for imbalance classification problem
Ng, W. W. Y., Zeng, G., Zhang, J., Yeung, D., & Witold Pedrycz, C. (2016) · Pattern Recognition · doi:10.1016/j.patcog.2016.06.013 · Cited by 107
Improving Facial Attribute Prediction Using Semantic Segmentation
Kalayeh, M. M., Gong, B., & Shah, M. A. (2017) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2017.450 · Cited by 93
Deep Face Recognition with Center Invariant Loss
Wu, Y., Liu, H., Li, J., & Fu, Y. (2017) · Thematic Workshops of ACM Multimedia · doi:10.1145/3126686.3126693 · Cited by 67
Local similarity-aware deep feature embedding
Huang, C., Loy, C. C., & Tang, X. (2016) · neural information processing systems · Cited by 67
Self-citationHand, E., Castillo, C. D., & Chellappa, R. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.12313 · Cited by 52
AFFACT: Alignment-free facial attribute classification technique
Günther, M., Rozsa, A., & Boult, T. E. (2017) · IEEE International Joint Conference on Biometrics (IJCB) · doi:10.1109/btas.2017.8272686 · Cited by 46
Discriminative Sparse Neighbor Approximation for Imbalanced Learning
Huang, C., Loy, C. C., & Tang, X. (2017) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2017.2671845 · Cited by 35
Self-citationFeature Transfer Learning for Deep Face Recognition with Long-Tail Data.
Yin, X. P., Yu, X., Sohn, K., Liu, X., & Chandraker, M. K. (2018) · Cited by 30
Cited by
Imbalance Problems in Object Detection: A Review
Oksuz, K., Cam, B. C., Kalkan, S., & Akbas, E. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2020.2981890 · Cited by 591
DeepSMOTE: Fusing Deep Learning and SMOTE for Imbalanced Data
Dablain, D., Krawczyk, B., & Chawla, N. V. (2023) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2021.3136503 · Cited by 591
Past, Present, and Future of Face Recognition: A Review
Adjabi, I., Ouahabi, A., Benzaoui, A., & Taleb-Ahmed, A. (2020) · Electronics · doi:10.3390/electronics9081188 · Cited by 560
A survey on imbalanced learning: latest research, applications and future directions
Chen, W., Yang, K., Yu, Z., Shi, Y., & Chen, C. L. P. (2024) · Artificial Intelligence Review · doi:10.1007/s10462-024-10759-6 · Cited by 506
The class imbalance problem in deep learning
Ghosh, K., Bellinger, C., Corizzo, R., Branco, P., Krawczyk, B., & Japkowicz, N. (2024) · Machine Learning · doi:10.1007/s10994-022-06268-8 · Cited by 312
Metadata
- Authors
- Huang, C., Li, Y., Loy, C. C., & Tang, X.
- Venue
- IEEE Transactions on Pattern Analysis and Machine Intelligence
- Published
- 2020-11-01
- Volume
- 42
- Issue
- 11
- Pages
- 2781-2794
- ISSN
- 0162-8828 (ISSN-L)
- 2160-9292
- 1939-3539
- OpenAlex
- W2963212406
- Cited by
- 354
- References
- 69
- FWCI
- 21.56
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.