The DOI matches its Crossref record; 67 of the 67 references it cites were found in a registry or an index.
Cost-Sensitive Learning of Deep Feature Representations From Imbalanced Data
Open accessAbstract
Class imbalance is a common problem in the case of real-world object detection and classification tasks. Data of some classes are abundant, making them an overrepresented majority, and data of other classes are scarce, making them an underrepresented minority. This imbalance makes it challenging for a classifier to appropriately learn the discriminating boundaries of the majority and minority classes. In this paper, we propose a cost-sensitive (CoSen) deep neural network, which can automatically learn robust feature representations for both the majority and minority classes. During training, our learning procedure jointly optimizes the class-dependent costs and the neural network parameters. The proposed approach is applicable to both binary and multiclass problems without any modification. Moreover, as opposed to data-level approaches, we do not alter the original data distribution, which results in a lower computational cost during the training process. We report the results of our experiments on six major image classification data sets and show that the proposed approach significantly outperforms the baseline algorithms. Comparisons with popular data sampling techniques and CoSen classifiers demonstrate the superior performance of our proposed method.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
LIBSVM: A library for support vector machines
Chang, C.-C., & Lin, C.-J. (2011) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/1961189.1961199 · Cited by 40,918
(2014) · Cited by 33,419
SMOTE synthetic minority over-sampling technique
Chawla, N. V., Bowyer, K. W., Hall, L. O., & Kegelmeyer, W. P. (2002) · Journal of Artificial Intelligence Research · doi:10.1613/jair.953 · Cited by 32,865
Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation
Girshick, R., Donahue, J., Darrell, T., & Malik, J. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.81 · Cited by 32,684
Visualizing and understanding convolutional networks
Zeiler, M. D., & Fergus, R. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10590-1_53 · Cited by 15,839
Spatial Pyramid Pooling in Deep Convolutional Networks for Visual Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2015) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2015.2389824 · Cited by 11,971
He, H., & Garcia, E. A. (2009) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2008.239 · Cited by 10,359
CNN Features Off-the-Shelf: An Astounding Baseline for Recognition
Razavian, A. S., Azizpour, H., Sullivan, J., & Carlsson, S. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition Workshops · doi:10.1109/cvprw.2014.131 · Cited by 4,451
Borderline-SMOTE : A New Over-Sampling Method in Imbalanced Data Sets Learning
Han, H., Wang, W.-Y., & Mao, B.-H. (2005) · Lecture notes in computer science · doi:10.1007/11538059_91 · Cited by 4,331
A study of the behavior of several methods for balancing machine learning training data
Batista, G. E. A. P. A., Prati, R. C., & Monard, M. C. (2004) · ACM SIGKDD Explorations Newsletter · doi:10.1145/1007730.1007735 · Cited by 4,203
DeCAF: A Deep Convolutional Activation Feature for Generic Visual Recognition
Donahue, J., Jia, Y., Vinyals, O., Hoffman, J., Zhang, N., Tzeng, E., & Darrell, T. (2013) · arXiv · doi:10.48550/arxiv.1310.1531 · Cited by 4,019 · cited 1×
“rged). Methods (using stand. split) Performances 15 trn. samples 30 trn. samples Multiple Kernels [44] 71.1 0.6 78.2 0.4 LLCy[45] 76.9 0.4 Imp. Fisher Kernely[46] 77.8 0.6 SPM-SC [47] 73.2 84.3 DeCAF [48] 86.9 0.7 Zeiler & Fergus [49] 83.8 0.5 86.5 0.5 Chatfield et al. [2] 88.3 0.6 SPP-net [50] 91.4 0.7 Our approac…”
InfluentialReturn of the Devil in the Details: Delving Deep into Convolutional Nets
Chatfield, K., Simonyan, K., Vedaldi, A., & Zisserman, A. (2014) · Proceedings of the British Machine Vision Conference 2014 · doi:10.5244/c.28.6 · Cited by 3,335
Locality-constrained Linear Coding for image classification
Wang, J., Yang, J., Yu, K., Lv, F., Huang, T., & Gong, Y. (2010) · 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2010.5540018 · Cited by 3,100
Spatial Pyramid Pooling in Deep Convolutional Networks for Visual Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10578-9_23 · Cited by 3,034
Linear spatial pyramid matching using sparse coding for image classification
Yang, J., Yu, K., Gong, Y., & Huang, T. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206757 · Cited by 2,828
Improving the Fisher Kernel for Large-Scale Image Classification
Perronnin, F., Sánchez, J., & Mensink, T. (2010) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-15561-1_11 · Cited by 2,588 · cited 1×
“Fisher Kernel† [45] − 77.”
Lee, H., Grosse, R., Ranganath, R., & Ng, A. Y. (2009) · Proceedings of the 26th Annual International Conference on Machine Learning · doi:10.1145/1553374.1553453 · Cited by 2,412
Using Random Forest to Learn Imbalanced Data
Chen, C., Liaw, A. I., & Breiman, L. (2004) · UC Berkeley · Cited by 1,340
Training cost-sensitive neural networks with methods addressing the class imbalance problem
Zhou, Z.-H., & Liu, X.-Y. (2006) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2006.17 · Cited by 1,326
Convexity, Classification, and Risk Bounds
Bartlett, P. L., Jordan, M. I., & McAuliffe, J. D. (2006) · Journal of the American Statistical Association · doi:10.1198/016214505000000907 · Cited by 1,037
Multi-scale Orderless Pooling of Deep Convolutional Activation Features
Gong, Y., Wang, L., Guo, R., & Lazebnik, S. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10584-0_26 · Cited by 1,030
Lee, C., Xie, S., Gallagher, P., Zhang, Z., & Zhuowen Tu, A. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1409.5185 · Cited by 993
SVMs Modeling for Highly Imbalanced Classification
Tang, Y., Zhang, Y.-Q., Chawla, N. V., & Krasser, S. (2009) · IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics) · doi:10.1109/tsmcb.2008.2002909 · Cited by 966
Bunkhumpornpat, C., Sinapiromsaran, K., & Lursinsap, C. (2009) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-01307-2_43 · Cited by 943
(2014) · arXiv (Cornell University) · Cited by 942
The devil is in the details: an evaluation of recent feature encoding methods
Chatfield, K., Lempitsky, V., Vedaldi, A., & Zisserman, A. (2011) · Procedings of the British Machine Vision Conference 2011 · doi:10.5244/c.25.76 · Cited by 834
KNN approach to unbalanced data distributions: a case study involving information extraction
Ziang, J. (2003) · International Conference on Machine Learning · Cited by 772
Multiple kernels for object detection
Vedaldi, A., Gulshan, V., Varma, M., & Zisserman, A. (2009) · 2009 IEEE 12th International Conference on Computer Vision · doi:10.1109/iccv.2009.5459183 · Cited by 757
Stochastic Pooling for Regularization of Deep Convolutional Neural Networks
Zeiler, M. D., & Fergus, R. (2013) · arXiv (Cornell University) · doi:10.48550/arxiv.1301.3557 · Cited by 755
Deep Learning via Semi-supervised Embedding
Weston, J., Ratle, F., Mobahi, H., & Collobert, R. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-35289-8_34 · Cited by 534
Training deep neural networks on imbalanced data sets
Wang, S., Liu, W., Wu, J., Cao, L., Meng, Q., & Kennedy, P. J. (2016) · 2016 International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2016.7727770 · Cited by 491
Ramentol, E., Caballero, Y., Bello, R., & Herrera, F. (2012) · Knowledge and Information Systems · doi:10.1007/s10115-011-0465-6 · Cited by 489
Class-Boundary Alignment for Imbalanced Dataset Learning
Wu, G., & Chang, E. Y. (2003) · Cited by 427
KBA: kernel boundary alignment considering imbalanced data distribution
Wu, G., & Chang, E. Y. (2005) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2005.95 · Cited by 380
Blocks That Shout: Distinctive Parts for Scene Classification
Juneja, M., Vedaldi, A., Jawahar, C. V., & Zisserman, A. (2013) · 2013 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2013.124 · Cited by 368
Automated annotation of coral reef survey images
Beijbom, O., Edmunds, P. J., Kline, D. I., Mitchell, B. G., & Kriegman, D. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6247798 · Cited by 319
Automatic Shadow Detection and Removal from a Single Image
Khan, S. H., Bennamoun, M., Sohel, F., & Togneri, R. (2016) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2015.2462355 · Cited by 283
Self-citationBoosting support vector machines for imbalanced data sets
Wang, B. X., & Japkowicz, N. (2010) · Knowledge and Information Systems · doi:10.1007/s10115-009-0198-y · Cited by 281
Ballerini, L., Fisher, R. B., Aldridge, B., & Rees, J. (2013) · Lecture Notes in Computational Vision and Biomechanics · doi:10.1007/978-94-007-5389-1_4 · Cited by 273
Cost-Sensitive Learning with Neural Networks.
Kukar, M., & Kononenko, I. (1998) · Cited by 273
Forest Change Detection in Incomplete Satellite Images With Deep Neural Networks
Khan, S. H., He, X., Porikli, F., & Bennamoun, M. (2017) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2017.2707528 · Cited by 271
Self-citationLocal neighbourhood extension of SMOTE for mining imbalanced data
Maciejewski, T., & Stefanowski, J. (2011) · 2011 IEEE Symposium on Computational Intelligence and Data Mining (CIDM) · doi:10.1109/cidm.2011.5949434 · Cited by 255
Mid-level Visual Element Discovery as Discriminative Mode Seeking
Doersch, C., Gupta, A., & Efros, A. A. (2013) · neural information processing systems · Cited by 238
Discriminative Transfer Learning with Tree-based Priors
Srivastava, N., & Salakhutdinov, R. (2013) · neural information processing systems · Cited by 199
Classification of Imbalanced Data by Combining the Complementary Neural Network and SMOTE Algorithm
Jeatrakul, P., Wong, K. W., & Fung, C. C. (2010) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-17534-3_19 · Cited by 185
Automatic Feature Learning for Robust Shadow Detection
Khan, S. H., Bennamoun, M., Sohel, F. A., & Togneri, R. B. (2014) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2014.249 · Cited by 159
Self-citationBoosting weighted ELM for imbalanced learning
Li, K., Kong, X., Lu, Z., Wenyin, L., & Yin, J. (2013) · Neurocomputing · doi:10.1016/j.neucom.2013.05.051 · Cited by 155
Wang, K., Makond, B., Chen, K.-H., & Wang, K.-M. (2013) · Applied Soft Computing · doi:10.1016/j.asoc.2013.09.014 · Cited by 149
An iterative method for multi-class cost-sensitive learning
Abe, N., Zadrozny, B., & Langford, J. C. (2004) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/1014052.1014056 · Cited by 148
Harvesting Mid-level Visual Concepts from Large-Scale Internet Images
Li, Q., Wu, J., & Tu, Z. (2013) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2013.115 · Cited by 147
A Discriminative Representation of Convolutional Features for Indoor Scene Recognition
Khan, S. H., Hayat, M., Bennamoun, M., Togneri, R., & Sohel, F. A. (2016) · IEEE Transactions on Image Processing · doi:10.1109/tip.2016.2567076 · Cited by 132
Self-citation(2013) · Cited by 131
Learning Important Spatial Pooling Regions for Scene Classification
Lin, D., Lu, C., Liao, R., & Jia, J. (2014) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2014.476 · Cited by 126
Batch-normalized Maxout Network in NetworkPreprint
Chang, J.-R., & Chen, Y. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1511.02583 · Cited by 119
On extending F-measure and G-mean metrics to multi-class problems
Espindola, R. P., & Ebecken, N. (2005) · Data Mining VI · doi:10.2495/data050031 · Cited by 116
Coral classification with hybrid feature representations
Mahmood, A., Bennamoun, M., An, S., Sohel, F. A., Boussaïd, F., Hovey, R. K., Kendrick, G. A., & Fisher, R. B. (2016) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2016.7532411 · Cited by 116
Self-citationLearning classifiers from imbalanced data based on biased minimax probability machine
Huang, K., Yang, H., King, I., & Lyu, M. R.-T. (2004) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2004.1315213 · Cited by 96
Cost-aware Pre-training for Multiclass Cost-sensitive Deep LearningPreprint
Chung, Y.-A., Lin, H.-T., & Yang, S. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1511.09337 · Cited by 91
Imbalanced data classification based on scaling kernel-based support vector machine
Zhang, Y., Fu, P., Liu, W., & Chen, G. (2014) · Neural Computing and Applications · doi:10.1007/s00521-014-1584-2 · Cited by 70
Stable and Efficient Representation Learning with Nonnegativity Constraints
Lin, T.-H., & Kung, H. T. (2014) · Digital Access to Scholarship at Harvard (DASH) (Harvard University) · Cited by 56
Towards Effective Classification of Imbalanced Data with Convolutional Neural Networks
Raj, V., Magg, S., & Wermter, S. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-46182-3_13 · Cited by 52
A Cost-Sensitive Ensemble Method for Class-Imbalanced Datasets
Zhang, Y., & Wang, D. (2013) · Abstract and Applied Analysis · doi:10.1155/2013/196256 · Cited by 39
Non-melanoma skin lesion classification using colour image data in a hierarchical K-NN classifier
Ballerini, L., Fisher, R. B., Aldridge, B., & Rees, J. (2012) · IEEE International Symposium on Biomedical Imaging (ISBI) · doi:10.1109/isbi.2012.6235558 · Cited by 36
Integrating Geometrical Context for Semantic Labeling of Indoor Scenes using RGBD Images
Khan, S. H., Bennamoun, M., Sohel, F. A., Togneri, R. B., & Naseem, I. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-015-0843-8 · Cited by 27
Self-citationGuess-Averse Loss Functions For Cost-Sensitive Multiclass Boosting
Beijbom, O., Saberian, M. J., Kriegman, D. J., & Vasconcelos, N. M. (2014) · Cited by 19
Cited by
Object Detection With Deep Learning: A Review
Zhao, Z.-Q., Zheng, P., Xu, S.-T., & Wu, X. (2019) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2018.2876865 · Cited by 5,545
Class-Balanced Loss Based on Effective Number of Samples
Cui, Y., Jia, M., Lin, T.-Y., Song, Y., & Belongie, S. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00949 · Cited by 3,094
A systematic study of the class imbalance problem in convolutional neural networks
Buda, M., Maki, A., & Mazurowski, M. A. (2018) · Neural Networks · doi:10.1016/j.neunet.2018.07.011 · Cited by 3,088
“Some previous studies showed results on cost sensitive learning of deep neural networks [24, 25, 26].”
ResultSurvey on deep learning with class imbalance
Johnson, J. M., & Khoshgoftaar, T. M. (2019) · Journal of Big Data · doi:10.1186/s40537-019-0192-5 · Cited by 3,032
SMOTE for Learning from Imbalanced Data: Progress and Challenges, Marking the 15-year Anniversary
Fernandez, A., Garcia, S., Herrera, F., & Chawla, N. V. (2018) · Journal of Artificial Intelligence Research · doi:10.1613/jair.1.11192 · Cited by 2,219
Metadata
- Authors
- Khan, S. H., Hayat, M., Bennamoun, M., Sohel, F. A., & Togneri, R.
- Venue
- IEEE Transactions on Neural Networks and Learning Systems
- Published
- 2018-08
- Volume
- 29
- Issue
- 8
- Pages
- 3573-3587
- ISSN
- 2162-237X (ISSN-L)
- 2162-2388
- OpenAlex
- W1753659477
- Cited by
- 967
- References
- 67
- FWCI
- 45.43
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.