The DOI matches its Crossref record; 83 of the 83 references it cites were found in a registry or an index.
Imbalanced Deep Learning by Minority Class Incremental Rectification
Open accessAbstract
Model learning from class imbalanced training data is a long-standing and significant challenge for machine learning. In particular, existing deep learning methods consider mostly either class balanced data or moderately imbalanced data in model training, and ignore the challenge of learning from significantly imbalanced training data. To address this problem, we formulate a class imbalanced deep learning model based on batch-wise incremental minority (sparsely sampled) class rectification by hard sample mining in majority (frequently sampled) classes during model training. This model is designed to minimise the dominant effect of majority classes by discovering sparsely sampled boundaries of minority classes in an iterative batch-wise learning process. To that end, we introduce a Class Rectification Loss (CRL) function that can be deployed readily in deep network architectures. Extensive experimental evaluations are conducted on three imbalanced person attribute benchmark datasets (CelebA, X-Domain, DeepFashion) and one balanced object category benchmark dataset (CIFAR-100). These experimental results demonstrate the performance advantages and model scalability of the proposed batch-wise incremental minority class rectification model over the existing state-of-the-art models for addressing the problem of imbalanced data learning.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805
Densely Connected Convolutional Networks
Huang, G., Liu, Z., Van Der Maaten, L., & Weinberger, K. Q. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.243 · Cited by 48,566
Microsoft COCO: Common Objects in Context
Lin, T.-Y., Maire, M., Belongie, S., Hays, J., Perona, P., Ramanan, D., Dollár, P., & Zitnick, C. L. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10602-1_48 · Cited by 45,460
ImageNet Large Scale Visual Recognition Challenge
Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., Bernstein, M., et al. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-015-0816-y · Cited by 39,380
Histograms of Oriented Gradients for Human Detection
Dalal, N., & Triggs, B. (2005) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) · doi:10.1109/cvpr.2005.177 · Cited by 33,584
SMOTE synthetic minority over-sampling technique
Chawla, N. V., Bowyer, K. W., Hall, L. O., & Kegelmeyer, W. P. (2002) · Journal of Artificial Intelligence Research · doi:10.1613/jair.953 · Cited by 32,865
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
Ioffe, S., & Szegedy, C. (2015) · arXiv · doi:10.48550/arxiv.1502.03167 · Cited by 27,818
Learning Multiple Layers of Features from Tiny Images
Krizhevsky, A. (2024) · doi:10.57702/zp44cu3g · Cited by 23,395
FaceNet: A unified embedding for face recognition and clustering
Schroff, F., Kalenichenko, D., & Philbin, J. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298682 · Cited by 15,267
Representation Learning: A Review and New Perspectives
Bengio, Y., Courville, A., & Vincent, P. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2013.50 · Cited by 13,001
He, H., & Garcia, E. A. (2009) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2008.239 · Cited by 10,359
Object Detection with Discriminatively Trained Part-Based Models
Felzenszwalb, P. F., Girshick, R. B., McAllester, D., & Ramanan, D. (2010) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2009.167 · Cited by 9,853
Deep Learning Face Attributes in the Wild
Liu, Z., Luo, P., Wang, X., & Tang, X. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.425 · Cited by 7,747
The Pascal Visual Object Classes Challenge: A Retrospective
Everingham, M., Eslami, S. M. A., Van Gool, L., Williams, C. K. I., Winn, J., & Zisserman, A. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-014-0733-5 · Cited by 7,139
CNN Features Off-the-Shelf: An Astounding Baseline for Recognition
Razavian, A. S., Azizpour, H., Sullivan, J., & Carlsson, S. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition Workshops · doi:10.1109/cvprw.2014.131 · Cited by 4,451
Borderline-SMOTE : A New Over-Sampling Method in Imbalanced Data Sets Learning
Han, H., Wang, W.-Y., & Mao, B.-H. (2005) · Lecture notes in computer science · doi:10.1007/11538059_91 · Cited by 4,331
Learning a Similarity Metric Discriminatively, with Application to Face Verification
Chopra, S., Hadsell, R., & LeCun, Y. (2005) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) · doi:10.1109/cvpr.2005.202 · Cited by 4,036
The class imbalance problem: A systematic study1
Japkowicz, N., & Stephen, S. (2002) · Intelligent Data Analysis · doi:10.3233/ida-2002-6504 · Cited by 3,295
Learning and Transferring Mid-level Image Representations Using Convolutional Neural Networks
Oquab, M., Bottou, L., Laptev, I., & Sivic, J. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.222 · Cited by 3,150
Training Region-Based Object Detectors with Online Hard Example Mining
Shrivastava, A., Gupta, A., & Girshick, R. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.89 · Cited by 2,686
Vlfeat: an open and portable library of computer vision algorithms
Vedaldi, A., & Fulkerson, B. (2010) · Proceedings of the 18th ACM international conference on Multimedia · doi:10.1145/1873951.1874249 · Cited by 2,664
Learning from imbalanced data: open challenges and future directions
Krawczyk, B. (2016) · Progress in Artificial Intelligence · doi:10.1007/s13748-016-0094-0 · Cited by 2,459
(2007) · CaltechAUTHORS (California Institute of Technology) · Cited by 2,274
Deep Learning Face Representation by Joint Identification-Verification
Sun, Y., Wang, X., & Tang, X. (2014) · arXiv · doi:10.48550/arxiv.1406.4773 · Cited by 1,906
Learning to rank for information retrieval
Liu, T.-Y. (2010) · Proceedings of the 33rd international ACM SIGIR conference on Research and development in information retrieval · doi:10.1145/1835449.1835676 · Cited by 1,856
DeepFashion: Powering Robust Clothes Recognition and Retrieval with Rich Annotations
Liu, Z., Luo, P., Qiu, S., Wang, X., & Tang, X. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.124 · Cited by 1,803
Deep Metric Learning via Lifted Structured Feature Embedding
Song, H. O., Xiang, Y., Jegelka, S., & Savarese, S. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.434 · Cited by 1,630
Learning to Rank for Information Retrieval
Liu, T.-Y. (2009) · Foundations and Trends® in Information Retrieval · doi:10.1561/1500000016 · Cited by 1,568
Regularized multi--task learning
Evgeniou, T., & Pontil, M. (2004) · Proceedings of the tenth ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/1014052.1014067 · Cited by 1,433
Mining with rarity: a unifying framework
Weiss, G. M. (2004) · ACM SIGKDD Explorations Newsletter · doi:10.1145/1007730.1007734 · Cited by 1,393
Using Random Forest to Learn Imbalanced Data
Chen, C., Liaw, A. I., & Breiman, L. (2004) · UC Berkeley · Cited by 1,340
Training cost-sensitive neural networks with methods addressing the class imbalance problem
Zhou, Z.-H., & Liu, X.-Y. (2006) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2006.17 · Cited by 1,326
A Framework for Learning Predictive Structures from Multiple Tasks and Unlabeled Data
Ando, R. K., & Zhang, T. (2005) · doi:10.5555/1046920.1194905 · Cited by 1,311
Learning Fine-Grained Image Similarity with Deep Ranking
Wang, J., Song, Y., Leung, T., Rosenberg, C., Wang, J., Philbin, J., Chen, B., & Wu, Y. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.180 · Cited by 1,269
Applying Support Vector Machines to Imbalanced Datasets
Akbani, R., Kwek, S., & Japkowicz, N. (2004) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-30115-8_7 · Cited by 1,134
Unsupervised Learning of Visual Representations Using Videos
Wang, X., & Gupta, A. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.320 · Cited by 1,005
Learning Deep Representation for Imbalanced Classification
Huang, C., Li, Y., Loy, C. C., & Tang, X. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.580 · Cited by 988
Cost-Sensitive Learning of Deep Feature Representations From Imbalanced Data
Khan, S. H., Hayat, M., Bennamoun, M., Sohel, F. A., & Togneri, R. (2018) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2017.2732482 · Cited by 967
SVMs Modeling for Highly Imbalanced Classification
Tang, Y., Zhang, Y.-Q., Chawla, N. V., & Krasser, S. (2009) · IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics) · doi:10.1109/tsmcb.2008.2002909 · Cited by 966
(2014) · arXiv (Cornell University) · Cited by 942
A survey of multiple classifier systems as hybrid systems
Woźniak, M., Graña, M., & Corchado, E. (2014) · Information Fusion · doi:10.1016/j.inffus.2013.04.006 · Cited by 912
C4.5, Class Imbalance, and Cost Sensitivity: Why Under-Sampling beats Over-Sampling
Drummond, C., & Holte, R. C. (2003) · Cited by 799
Mazurowski, M. A., Habas, P. A., Zurada, J. M., Lo, J. Y., Baker, J. A., & Tourassi, G. D. (2008) · Neural Networks · doi:10.1016/j.neunet.2007.12.031 · Cited by 737
Cost-sensitive learning by cost-proportionate example weighting
Zadrozny, B., Langford, J., & Abe, N. (2004) · Third IEEE International Conference on Data Mining · doi:10.1109/icdm.2003.1250950 · Cited by 680
Strategies for learning in class imbalance problems
Barandela, R., Sánchez, J. S., Garcı́a, V, & Rangel, E. (2003) · Pattern Recognition · doi:10.1016/s0031-3203(02)00257-1 · Cited by 579
DeepContour: A deep convolutional feature learned by positive-sharing loss for contour detection
Shen, W., Wang, X., Wang, Y., Bai, X., & Zhang, Z. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7299024 · Cited by 515
PANDA: Pose Aligned Networks for Deep Attribute Modeling
Zhang, N., Paluri, M., Ranzato, M., Darrell, T., & Bourdev, L. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.212 · Cited by 495
Training deep neural networks on imbalanced data sets
Wang, S., Liu, W., Wu, J., Cao, L., Meng, Q., & Kennedy, P. J. (2016) · 2016 International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2016.7727770 · Cited by 491
VLFeat: An open and portable library of computer vision algorithms
Vedaldi, A., & Fulkerson, B. (2010) · Cited by 485
Learning from Imbalanced Data Sets: A Comparison of Various Strategies *
Japkowicz, N. (2000) · Cited by 455
Cumulative Attribute Space for Age and Crowd Density Estimation
Chen, K., Gong, S., Xiang, T., & Loy, C. C. (2013) · 2013 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2013.319 · Cited by 453
Self-citationLearning and making decisions when costs and probabilities are both unknown
Zadrozny, B., & Elkan, C. (2001) · Proceedings of the seventh ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/502512.502540 · Cited by 445
Cross-Domain Image Retrieval with a Dual Attribute-Aware Ranking Network
Huang, J., Feris, R., Chen, Q., & Yan, S. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.127 · Cited by 410
KBA: kernel boundary alignment considering imbalanced data distribution
Wu, G., & Chang, E. Y. (2005) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2005.95 · Cited by 380
Machine Learning from Imbalanced Data Sets 101
Provost, F. J. (2008) · Faculty Digital Archive (New York University Florence) · Cited by 378
(2014) · Advances in Computer Vision and Pattern Recognition · doi:10.1007/978-1-4471-6296-4 · Cited by 365
Support Vector Machines for Classification in Nonstandard Situations
Lin, Y., Lee, Y., & Wahba, G. (2002) · Machine Learning · doi:10.1023/a:1012406528296 · Cited by 348
How slow is the k -means method?
Arthur, D., & Vassilvitskii, S. (2006) · Proceedings of the twenty-second annual symposium on Computational geometry · doi:10.1145/1137856.1137880 · Cited by 304
A Comparative Study of Cost-Sensitive Boosting Algorithms
Ting, K. M. (2000) · Cited by 262
Local neighbourhood extension of SMOTE for mining imbalanced data
Maciejewski, T., & Stefanowski, J. (2011) · 2011 IEEE Symposium on Computational Intelligence and Data Mining (CIDM) · doi:10.1109/cidm.2011.5949434 · Cited by 255
Deep domain adaptation for describing people based on fine-grained clothing attributes
Chen, Q., Huang, J., Feris, R., Brown, L. M., Dong, J., & Yan, S. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7299169 · Cited by 241
Novel Cost-Sensitive Approach to Improve the Multilayer Perceptron Performance on Imbalanced Data
Castro, C. L., & Braga, A. P. (2013) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2013.2246188 · Cited by 235
Learning Deep Embeddings with Histogram Loss
Ustinova, E., & Lempitsky, V. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.00822 · Cited by 222
Classification of Imbalanced Data by Combining the Complementary Neural Network and SMOTE Algorithm
Jeatrakul, P., Wong, K. W., & Fung, C. C. (2010) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-17534-3_19 · Cited by 185
Deep Learning for Imbalanced Multimedia Data Classification
Yan, Y., Chen, M., Shyu, M., & Chen, S. (2015) · IEEE International Symposium on Multimedia (ISM) · doi:10.1109/ism.2015.126 · Cited by 185
Huang, Y.-M., Hung, C.-M., & Jiau, H. C. (2006) · Nonlinear Analysis: Real World Applications · doi:10.1016/j.nonrwa.2005.04.006 · Cited by 161
Improving an Association Rule Based Classifier
Liu, B., Ma, Y., & Wong, C. K. (2000) · Lecture Notes in Computer Science · doi:10.1007/3-540-45372-5_58 · Cited by 160
A dynamic over-sampling procedure based on sensitivity for multi-class problems
Fernández‐Navarro, F., Hervás‐Martínez, C., & Gutiérrez, P. A. (2011) · Pattern Recognition · doi:10.1016/j.patcog.2011.02.019 · Cited by 153
Triguero, I., del Río, S., López, V., Bacardit, J., Benítez, J. M., & Herrera, F. (2015) · Knowledge-Based Systems · doi:10.1016/j.knosys.2015.05.027 · Cited by 150
Multi-task Curriculum Transfer Deep Learning of Clothing Attributes
Dong, Q., Gong, S., & Zhu, X. (2017) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv.2017.64 · Cited by 98
Self-citationYu, H., Sun, C., Yang, X., Yang, W., Shen, J., & Qi, Y. (2015) · Knowledge-Based Systems · doi:10.1016/j.knosys.2015.10.012 · Cited by 96
Wang, S., Li, Z., Chao, W., & Cao, Q. (2012) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2012.6252696 · Cited by 90
Decision threshold adjustment in class prediction
Chen, J. J., Tsai, C., Moon, H., Ahn, H., Young, J., & Chen, C. (2006) · SAR and QSAR in environmental research · doi:10.1080/10659360600787700 · Cited by 89
Improved Estimates for the Accuracy of Small Disjuncts
Quinlan, J. R. (1991) · Machine Learning · doi:10.1007/bf00153762 · Cited by 88
Khoshgoftaar, T. M., Hulse, J. V., & Napolitano, A. (2010) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2010.2042730 · Cited by 82
Attribute-based People Search: Lessons Learnt from a Practical Surveillance System
Feris, R., Bobbitt, R., Brown, L., & Pankanti, S. (2014) · International Conference on Multimedia Retrieval · doi:10.1145/2578726.2578732 · Cited by 80
Finding Rare Classes: Active Learning with Generative and Discriminative Models
Hospedales, T. M., Gong, S., & Xiang, T. (2011) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2011.231 · Cited by 79
Self-citationCost-Sensitive Neural Network with ROC-Based Moving Threshold for Imbalanced Classification
Krawczyk, B., & Woźniak, M. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-24834-9_6 · Cited by 32
An investigation of neural network classifiers with unequal misclassification costs and group sizes
Lan, J., Hu, M. Y., Patuwo, B. E., & Zhang, G. P. (2009) · Decision Support Systems · doi:10.1016/j.dss.2009.11.008 · Cited by 27
Deep Learning with MCA-based Instance Selection and Bootstrapping for Imbalanced Data Classification
Guan, S. U., Chen, M., Ha, H.-Y., Chen, S., Shyu, M., & Zhang, C. (2015) · IEEE International Conference on Collaboration and Internet Computing (CIC) · doi:10.1109/cic.2015.40 · Cited by 18
Cited by
Survey on deep learning with class imbalance
Johnson, J. M., & Khoshgoftaar, T. M. (2019) · Journal of Big Data · doi:10.1186/s40537-019-0192-5 · Cited by 3,032
DeepSMOTE: Fusing Deep Learning and SMOTE for Imbalanced Data
Dablain, D., Krawczyk, B., & Chawla, N. V. (2023) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2021.3136503 · Cited by 591
Online continual learning in image classification: An empirical survey
Mai, Z., Li, R., Jeong, J., Quispe, D., Kim, H., & Sanner, S. (2022) · Neurocomputing · doi:10.1016/j.neucom.2021.10.021 · Cited by 410
Deep learning based brain tumor segmentation: a survey
Liu, Z., Tong, L., Chen, L., Jiang, Z., Zhou, F., Zhang, Q., Zhang, X., Jin, Y., & Zhou, H. (2023) · Complex & Intelligent Systems · doi:10.1007/s40747-022-00815-5 · Cited by 402
Fernando, K. R. M., & Tsokos, C. P. (2022) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2020.3047335 · Cited by 329
Metadata
- Authors
- Dong, Q., Gong, S., & Zhu, X.
- Venue
- IEEE Transactions on Pattern Analysis and Machine Intelligence
- Published
- 2019-06-01
- Volume
- 41
- Issue
- 6
- Pages
- 1367-1381
- ISSN
- 0162-8828 (ISSN-L)
- 2160-9292
- 1939-3539
- OpenAlex
- W2798869704
- Cited by
- 369
- References
- 83
- FWCI
- 21.78
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.