The DOI matches its Crossref record; 48 of the 48 references it cites were found in a registry or an index.
Learning Deep Representation for Imbalanced Classification
Abstract
Data in vision domain often exhibit highly-skewed class distribution, i.e., most data belong to a few majority classes, while the minority classes only contain a scarce amount of instances. To mitigate this issue, contemporary classification methods based on deep convolutional neural network (CNN) typically follow classic strategies such as class re-sampling or cost-sensitive training. In this paper, we conduct extensive and systematic experiments to validate the effectiveness of these classic schemes for representation learning on class-imbalanced data. We further demonstrate that more discriminative deep representation can be learned by enforcing a deep network to maintain both intercluster and inter-class margins. This tighter constraint effectively reduces the class imbalance inherent in the local data neighborhood. We show that the margins can be easily deployed in standard deep learning framework through quintuplet instance sampling and the associated triple-header hinge loss. The representation learned by our approach, when combined with a simple k-nearest neighbor (kNN) algorithm, shows significant improvements over existing methods on both high-and low-level vision classification tasks that exhibit imbalanced class distribution.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
SMOTE synthetic minority over-sampling technique
Chawla, N. V., Bowyer, K. W., Hall, L. O., & Kegelmeyer, W. P. (2002) · Journal of Artificial Intelligence Research · doi:10.1613/jair.953 · Cited by 32,865
FaceNet: A unified embedding for face recognition and clustering
Schroff, F., Kalenichenko, D., & Philbin, J. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298682 · Cited by 15,267
He, H., & Garcia, E. A. (2009) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2008.239 · Cited by 10,359
Deep Learning Face Attributes in the Wild
Liu, Z., Luo, P., Wang, X., & Tang, X. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.425 · Cited by 7,747
Self-citationContour Detection and Hierarchical Image Segmentation
Arbeláez, P., Maire, M., Fowlkes, C., & Malik, J. (2011) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2010.161 · Cited by 5,454
Dimensionality Reduction by Learning an Invariant Mapping
Hadsell, R., Chopra, S., & LeCun, Y. (2006) · 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 2 (CVPR'06) · doi:10.1109/cvpr.2006.100 · Cited by 5,336
Borderline-SMOTE : A New Over-Sampling Method in Imbalanced Data Sets Learning
Han, H., Wang, W.-Y., & Mao, B.-H. (2005) · Lecture notes in computer science · doi:10.1007/11538059_91 · Cited by 4,331
Distance Metric Learning for Large Margin Nearest Neighbor Classification
Weinberger, K. Q., & Saul, L. K. (2009) · Journal of Machine Learning Research · doi:10.5555/1577069.1577078 · Cited by 4,044
Learning and Transferring Mid-level Image Representations Using Convolutional Neural Networks
Oquab, M., Bottou, L., Laptev, I., & Sivic, J. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.222 · Cited by 3,150 · cited 5×
“Cl as s i m ba la nc e le ve l ( % ) Face attribute Over PANDA [32] Over Triplet-kNN [22]”
BackgroundInfluential
Cited by
Class-Balanced Loss Based on Effective Number of Samples
Cui, Y., Jia, M., Lin, T.-Y., Song, Y., & Belongie, S. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00949 · Cited by 3,094
Survey on deep learning with class imbalance
Johnson, J. M., & Khoshgoftaar, T. M. (2019) · Journal of Big Data · doi:10.1186/s40537-019-0192-5 · Cited by 3,032
Deep learning and its applications to machine health monitoring
Zhao, R., Yan, R., Chen, Z., Mao, K., Wang, P., & Gao, R. X. (2019) · Mechanical Systems and Signal Processing · doi:10.1016/j.ymssp.2018.05.050 · Cited by 2,894
GOT-10k: A Large High-Diversity Benchmark for Generic Object Tracking in the Wild
Huang, L., Zhao, X., & Huang, K. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2019.2957464 · Cited by 1,809
Learning a Unified Classifier Incrementally via Rebalancing
Hou, S., Pan, X., Loy, C. C., Wang, Z., & Lin, D. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00092 · Cited by 1,195
Self-citationSimple Copy-Paste is a Strong Data Augmentation Method for Instance Segmentation
Ghiasi, G., Cui, Y., Srinivas, A., Qian, R., Lin, T.-Y., Cubuk, E. D., Le, Q. V., & Zoph, B. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00294 · Cited by 1,148
Large-Scale Long-Tailed Recognition in an Open World
Liu, Z., Miao, Z., Zhan, X., Wang, J., Gong, B., & Yu, S. X. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00264 · Cited by 1,126
BBN: Bilateral-Branch Network With Cumulative Learning for Long-Tailed Visual Recognition
Zhou, B., Cui, Q., Wei, X.-S., & Chen, Z.-M. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00974 · Cited by 901
Deep Long-Tailed Learning: A Survey
Zhang, Y., Kang, B., Hooi, B., Yan, S., & Feng, J. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2023.3268118 · Cited by 769
Learning to Reweight Examples for Robust Deep Learning
Ren, M., Zeng, W., Yang, B., & Urtasun, R. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1803.09050 · Cited by 740
Asymmetric Loss For Multi-Label Classification
Ridnik, T., Ben-Baruch, E., Zamir, N., Noy, A., Friedman, I., Protter, M., & Zelnik-Manor, L. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00015 · Cited by 660
Imbalance Problems in Object Detection: A Review
Oksuz, K., Cam, B. C., Kalkan, S., & Akbas, E. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2020.2981890 · Cited by 591
Trustworthy AI: From Principles to Practices
Li, B., Qi, P., Liu, B., Di, S., Liu, J., Pei, J., Yi, J., & Zhou, B. (2023) · ACM Computing Surveys · doi:10.1145/3555803 · Cited by 612
“Aside from helping to balance the classification accuracy, these approaches can be applied to balance the cost of classification errors to improve performance on certain groups [163] (e.”
Maintaining Discrimination and Fairness in Class Incremental Learning
Zhao, B., Xiao, X., Gan, G., Zhang, B., & Xia, S.-T. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.01322 · Cited by 494
Equalization Loss for Long-Tailed Object Recognition
Tan, J., Wang, C., Li, B., Li, Q., Ouyang, W., Yin, C., & Yan, J. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.01168 · Cited by 488
A survey on deep learning based face recognition
Guo, G., & Zhang, N. (2019) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2019.102805 · Cited by 485
Deep learning and computer vision will transform entomology
Høye, T. T., Ärje, J., Bjerge, K., Hansen, O. L. P., Iosifidis, A., Leese, F., Mann, H. M. R., Meissner, K., Melvad, C., & Raitoharju, J. (2021) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2002545117 · Cited by 469
A convolutional neural network for sleep stage scoring from raw single-channel EEG
Sors, A., Bonnet, S., Mirek, S., Vercueil, L., & Payen, J.-F. (2018) · Biomedical Signal Processing and Control · doi:10.1016/j.bspc.2017.12.001 · Cited by 424
Meta-Weight-Net: Learning an Explicit Mapping For Sample Weighting
Shu, J., Xie, Q., Yi, L., Zhao, Q., Zhou, S., Xu, Z., & Meng, D. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1902.07379 · Cited by 385
Imbalanced Deep Learning by Minority Class Incremental Rectification
Dong, Q., Gong, S., & Zhu, X. (2019) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2018.2832629 · Cited by 369
Deep Imbalanced Learning for Face Recognition and Attribute Prediction
Huang, C., Li, Y., Loy, C. C., & Tang, X. (2020) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2019.2914680 · Cited by 354
Self-citationFeature Transfer Learning for Face Recognition With Under-Represented Data
Yin, X., Yu, X., Sohn, K., Liu, X., & Chandraker, M. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00585 · Cited by 346
Wang, C., Deng, C., & Wang, S. (2020) · Pattern Recognition Letters · doi:10.1016/j.patrec.2020.05.035 · Cited by 317
The class imbalance problem in deep learning
Ghosh, K., Bellinger, C., Corizzo, R., Branco, P., Krawczyk, B., & Japkowicz, N. (2024) · Machine Learning · doi:10.1007/s10994-022-06268-8 · Cited by 312
Balanced Meta-Softmax for Long-Tailed Visual Recognition
Ren, J., Yu, C., sheng, S., Ma, X., Zhao, H., Yi, S., & Li, H. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2007.10740 · Cited by 307
From Facial Expression Recognition to Interpersonal Relation Prediction
Zhang, Z., Luo, P., Loy, C. C., & Tang, X. (2018) · International Journal of Computer Vision · doi:10.1007/s11263-017-1055-1 · Cited by 302
Self-citationDistribution Alignment: A Unified Framework for Long-tail Visual Recognition
Zhang, S., Li, Z., Yan, S., He, X., & Sun, J. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00239 · Cited by 300
Contrastive Learning based Hybrid Networks for Long-Tailed Image Classification
Wang, P., Han, K., Wei, X.-S., Zhang, L., & Wang, L. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00100 · Cited by 294
On the class overlap problem in imbalanced data classification
Vuttipittayamongkol, P., Elyan, E., & Petrovski, A. (2021) · Knowledge-Based Systems · doi:10.1016/j.knosys.2020.106631 · Cited by 290
Parametric Contrastive Learning
Cui, J., Zhong, Z., Liu, S., Yu, B., & Jia, J. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00075 · Cited by 290
Improving Calibration for Long-Tailed Recognition
Zhong, Z., Cui, J., Liu, S., & Jia, J. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.01622 · Cited by 282
Heterogeneous Face Attribute Estimation: A Deep Multi-Task Learning Approach
Han, H., Jain, A. K., Wang, F., Shan, S., & Chen, X. (2018) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2017.2738004 · Cited by 278
Image Aesthetic Assessment: An experimental survey
Deng, Y., Loy, C. C., & Tang, X. (2017) · IEEE Signal Processing Magazine · doi:10.1109/msp.2017.2696576 · Cited by 306
“uating testing partition with imbalanced distribution [54], [55].”
BackgroundSelf-citationDynamic Curriculum Learning for Imbalanced Data Classification
Wang, Y., Gan, W., Yang, J., Wu, W., & Yan, J. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00512 · Cited by 261
Distribution-Balanced Loss for Multi-label Classification in Long-Tailed Datasets
Wu, T., Huang, Q., Liu, Z., Wang, Y., & Lin, D. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58548-8_10 · Cited by 260
Lin, K., Gong, L., Huang, Y., Liu, C., & Pan, J. (2019) · Frontiers in Plant Science · doi:10.3389/fpls.2019.00155 · Cited by 257
Disentangling Label Distribution for Long-tailed Visual Recognition
Hong, Y., Han, S., Choi, K., Seo, S., Kim, B., & Chang, B. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00656 · Cited by 255
Delving into deep imbalanced regression
Yang, Y., Zha, K., Chen, Y.-C., Wang, H., & Katabi, D. (2021) · arXiv · doi:10.48550/arxiv.2102.09554 · Cited by 229
Striking the Right Balance With Uncertainty
Khan, S., Hayat, M., Zamir, S. W., Shen, J., & Shao, L. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00019 · Cited by 180
Mehta, N. K., Prasad, S. S., Saurav, S., Saini, R., & Singh, S. (2022) · Applied Intelligence · doi:10.1007/s10489-022-03200-4 · Cited by 97
Adding Stochastic Negative Examples into Machine Learning Improves Molecular Bioactivity Prediction
Cáceres, E. L., Mew, N. C., & Keiser, M. J. (2020) · Journal of Chemical Information and Modeling · doi:10.1021/acs.jcim.0c00565 · Cited by 33
From Data Quality to Model Quality: An Exploratory Study on Deep Learning
He, T., Yu, S., Wang, Z., Li, J., & Chen, Z. (2019) · Proceedings of the 11th Asia-Pacific Symposium on Internetware · doi:10.1145/3361242.3361260 · Cited by 24
Deep active learning with Weighting filter for object detection
Huang, W., Sun, S., Lin, X., Zhang, D., & Ma, L. (2023) · Displays · doi:10.1016/j.displa.2022.102282 · Cited by 11
Metadata
- Authors
- Huang, C., Li, Y., Loy, C. C., & Tang, X.
- Venue
- 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
- Publisher
- IEEE
- Published
- 2016-06
- Pages
- 5375-5384
- ISSN
- 1063-6919 (ISSN-L)
- OpenAlex
- W2440599146
- Cited by
- 988
- References
- 48
- FWCI
- 27.95
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.