The DOI matches its Crossref record; 62 of the 62 references it cites were found in a registry or an index.
A Cost-Sensitive Deep Belief Network for Imbalanced Classification
Abstract
Imbalanced data with a skewed class distribution are common in many real-world applications. Deep Belief Network (DBN) is a machine learning technique that is effective in classification tasks. However, conventional DBN does not work well for imbalanced data classification because it assumes equal costs for each class. To deal with this problem, cost-sensitive approaches assign different misclassification costs for different classes without disrupting the true data sample distributions. However, due to lack of prior knowledge, the misclassification costs are usually unknown and hard to choose in practice. Moreover, it has not been well studied as to how cost-sensitive learning could improve DBN performance on imbalanced data problems. This paper proposes an evolutionary cost-sensitive deep belief network (ECS-DBN) for imbalanced classification. ECS-DBN uses adaptive differential evolution to optimize the misclassification costs based on the training data that presents an effective approach to incorporating the evaluation measure (i.e., G-mean) into the objective function. We first optimize the misclassification costs, and then apply them to DBN. Adaptive differential evolution optimization is implemented as the optimization algorithm that automatically updates its corresponding parameters without the need of prior domain knowledge. The experiments have shown that the proposed approach consistently outperforms the state of the art on both benchmark data sets and real-world data set for fault diagnosis in tool condition monitoring.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Scikit-learn: Machine Learning in Python
Pedregosa, F., Varoquaux, G., Gramfort, A., Michel, V., Thirion, B., Grisel, O., Blondel, M., Müller, A., Nothman, J., Louppe, G., et al. (2012) · arXiv · doi:10.48550/arxiv.1201.0490 · Cited by 71,016
SMOTE synthetic minority over-sampling technique
Chawla, N. V., Bowyer, K. W., Hall, L. O., & Kegelmeyer, W. P. (2002) · Journal of Artificial Intelligence Research · doi:10.1613/jair.953 · Cited by 32,865
Reducing the dimensionality of data with neural networks
Hinton, G. E., & Salakhutdinov, R. R. (2006) · Science · doi:10.1126/science.1127647 · Cited by 20,928
A fast learning algorithm for deep belief nets
Hinton, G. E., Osindero, S., & Teh, Y.-W. (2006) · Neural Computation · doi:10.1162/neco.2006.18.7.1527 · Cited by 16,336
He, H., & Garcia, E. A. (2009) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2008.239 · Cited by 10,359
Statistical Decision Theory and Bayesian Analysis
Berger, J. O. (1985) · Springer Series in Statistics · doi:10.1007/978-1-4757-4286-2 · Cited by 7,722
ADASYN: Adaptive synthetic sampling approach for imbalanced learning
He, H., Bai, Y., Garcia, E. A., & Li, S. (2008) · 2008 IEEE International Joint Conference on Neural Networks (IEEE World Congress on Computational Intelligence) · doi:10.1109/ijcnn.2008.4633969 · Cited by 4,521
Borderline-SMOTE : A New Over-Sampling Method in Imbalanced Data Sets Learning
Han, H., Wang, W.-Y., & Mao, B.-H. (2005) · Lecture notes in computer science · doi:10.1007/11538059_91 · Cited by 4,331
Firefly Algorithms for Multimodal Optimization
Yang, X.-S. (2009) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-04944-6_14 · Cited by 4,075
JADE: Adaptive Differential Evolution With Optional External Archive
Zhang, J., & Sanderson, A. C. (2009) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2009.2014613 · Cited by 3,739
A Practical Guide to Training Restricted Boltzmann Machines
Hinton, G. E. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-35289-8_32 · Cited by 2,852
Galar, M., Fernandez, A., Barrenechea, E., Bustince, H., & Herrera, F. (2012) · IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews) · doi:10.1109/tsmcc.2011.2161285 · Cited by 2,794
The foundations of cost-sensitive learning
Elkan, C. (2001) · Cited by 1,945
Acoustic Modeling Using Deep Belief Networks
Mohamed, A.-R., Dahl, G. E., & Hinton, G. (2012) · IEEE Transactions on Audio, Speech, and Language Processing · doi:10.1109/tasl.2011.2109382 · Cited by 1,727
Imbalanced-learn: A Python Toolbox to Tackle the Curse of Imbalanced Datasets in Machine Learning
Lemaître, G., Nogueira, F., & Aridas, C. K. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1609.06570 · Cited by 1,514
KEEL: a software tool to assess evolutionary algorithms for data mining problems
Alcalá-Fdez, J., Sánchez, L., García, S., del Jesus, M. J., Ventura, S., Garrell, J. M., Otero, J., Romero, C., Bacardit, J., Rivas, V. M., et al. (2009) · Soft Computing · doi:10.1007/s00500-008-0323-y · Cited by 1,505
Training cost-sensitive neural networks with methods addressing the class imbalance problem
Zhou, Z.-H., & Liu, X.-Y. (2006) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2006.17 · Cited by 1,326
Self-adaptive Differential Evolution Algorithm for Numerical Optimization
Qin, A. K., & Suganthan, P. N. (2005) · 2005 IEEE Congress on Evolutionary Computation · doi:10.1109/cec.2005.1554904 · Cited by 1,215
The "Wake-Sleep" Algorithm for Unsupervised Neural Networks
Hinton, G. E., Dayan, P., Frey, B. J., & Neal, R. M. (1995) · Science · doi:10.1126/science.7761831 · Cited by 1,070
Cost-Sensitive Learning of Deep Feature Representations From Imbalanced Data
Khan, S. H., Hayat, M., Bennamoun, M., Sohel, F. A., & Togneri, R. (2018) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2017.2732482 · Cited by 967
Fawcett, T., & Provost, F. (1997) · Data Mining and Knowledge Discovery · doi:10.1023/a:1009700419189 · Cited by 881
Multiobjective Deep Belief Networks Ensemble for Remaining Useful Life Estimation in Prognostics
Zhang, C., Lim, P., Qin, A. K., & Tan, K. C. (2017) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2016.2582798 · Cited by 870
Self-citationImbalanced Learning: Foundations, Algorithms, and Applications
(2013) · Wiley eBooks · doi:10.1002/9781118646106 · Cited by 831
C4.5, Class Imbalance, and Cost Sensitivity: Why Under-Sampling beats Over-Sampling
Drummond, C., & Holte, R. C. (2003) · Cited by 799
Weighted extreme learning machine for imbalance learning
Zong, W., Huang, G.-B., & Chen, Y. (2013) · Neurocomputing · doi:10.1016/j.neucom.2012.08.010 · Cited by 743
Borderline over-sampling for imbalanced data classification
Nguyen, H. M., Cooper, E. W., & Kamei, K. (2011) · International Journal of Knowledge Engineering and Soft Data Paradigms · doi:10.1504/ijkesdp.2011.039875 · Cited by 592
Differential Evolution With Neighborhood Mutation for Multimodal Optimization
Qu, B. Y., Suganthan, P. N., & Liang, J. J. (2012) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2011.2161873 · Cited by 442
Evolutionary Undersampling for Classification with Imbalanced Datasets: Proposals and Taxonomy
García, S., & Herrera, F. (2009) · Evolutionary Computation · doi:10.1162/evco.2009.17.3.275 · Cited by 414
Deep Belief Networks using discriminative features for phone recognition
Mohamed, A.-R., Sainath, T. N., Dahl, G., Ramabhadran, B., Hinton, G. E., & Picheny, M. A. (2011) · 2011 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2011.5947494 · Cited by 286
Cost-Sensitive Learning with Neural Networks.
Kukar, M., & Kononenko, I. (1998) · Cited by 273
Evolving Diverse Ensembles Using Genetic Programming for Classification With Unbalanced Data
Bhowan, U., Johnston, M., Zhang, M., & Yao, X. (2013) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2012.2199119 · Cited by 259
Novel Cost-Sensitive Approach to Improve the Multilayer Perceptron Performance on Imbalanced Data
Castro, C. L., & Braga, A. P. (2013) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2013.2246188 · Cited by 235
Cost-sensitive boosting neural networks for software defect prediction
Zheng, J. (2010) · Expert Systems with Applications · doi:10.1016/j.eswa.2009.12.056 · Cited by 225
Evolutionary rule-based systems for imbalanced data sets
Orriols-Puig, A., & Bernadó-Mansilla, E. (2009) · Soft Computing · doi:10.1007/s00500-008-0319-7 · Cited by 198
Zhang, C., Yao, X., Zhang, J., & Jin, H. (2016) · Sensors · doi:10.3390/s16060795 · Cited by 181
Self-citationOnline Bagging and Boosting for Imbalanced Data Streams
Wang, B., & Pineau, J. (2016) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2016.2609424 · Cited by 181
Datta, S., & Das, S. (2015) · Neural Networks · doi:10.1016/j.neunet.2015.06.005 · Cited by 166
Dynamic Sampling Approach to Training Neural Networks for Multiclass Imbalance Classification
Lin, M., Tang, K., & Yao, X. (2013) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2012.2228231 · Cited by 165
Evolutionary Cluster-Based Synthetic Oversampling Ensemble (ECO-Ensemble) for Imbalance Learning
Lim, P., Goh, C. K., & Tan, K. C. (2017) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2016.2579658 · Cited by 160
Self-citationEvolutionary Cost-Sensitive Extreme Learning Machine
Zhang, L., & Zhang, D. (2017) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2016.2607757 · Cited by 160
Evolutionary-based selection of generalized instances for imbalanced classification
́a, S. G., Derrac, J., Triguero, I., Carmona, C. J., & Herrera, F. (2011) · Knowledge-Based Systems · doi:10.1016/j.knosys.2011.01.012 · Cited by 154
Learning goal oriented Bayesian networks for telecommunications risk management
Ezawa, K. J., Singh, M., & Norton, S. W. (1996) · Cited by 124
Multiclassification of tool wear with support vector machine by manufacturing loss consideration
Sun, J., Rahman, M., Wong, Y. S., & Hong, G. S. (2004) · International Journal of Machine Tools and Manufacture · doi:10.1016/j.ijmachtools.2004.04.003 · Cited by 117
Self-citationMulti-objective genetic fuzzy classifiers for imbalanced and cost-sensitive datasets
Ducange, P., Lazzerini, B., & Marcelloni, F. (2009) · Soft Computing · doi:10.1007/s00500-009-0460-y · Cited by 108
Reusing Genetic Programming for Ensemble Selection in Classification of Unbalanced Data
Bhowan, U., Johnston, M., Zhang, M., & Yao, X. (2014) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2013.2293393 · Cited by 104
Using evolutionary sampling to mine imbalanced data
Drown, D. J., Khoshgoftaar, T. M., & Narayanan, R. (2007) · International Conference on Machine Learning and Applications · doi:10.1109/icmla.2007.73 · Cited by 69
Evolutionary Fuzzy ARTMAP Neural Networks for Classification of Semiconductor Defects
Tan, S. C., Watada, J., Ibrahim, Z., & Khalid, M. (2014) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2014.2329097 · Cited by 67
Class imbalance handling using wrapper-based random oversampling
Ghazikhani, A., Yazdi, H. S., & Monsefi, R. (2012) · Iranian Conference on Electrical Engineering · doi:10.1109/iraniancee.2012.6292428 · Cited by 62
Biermann, D., & Kirschner, M. (2015) · Journal of Manufacturing Processes · doi:10.1016/j.jmapro.2015.06.001 · Cited by 51
Wang, P., Emmerich, M., Li, R., Tang, K., Bäck, T., & Yao, X. (2014) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2014.2305671 · Cited by 51
A Sparse Spectral Clustering Framework via Multiobjective Evolutionary Algorithm
Luo, J., Jiao, L., & Lozano, J. A. (2015) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2015.2476359 · Cited by 49
Krempl, G., Kottke, D., & Lemaire, V. (2015) · Machine Learning · doi:10.1007/s10994-015-5504-1 · Cited by 44
Deep Belief Networks Ensemble with Multi-objective Optimization for Failure Diagnosis
Zhang, C., Sun, J. H., & Tan, K. C. (2015) · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/smc.2015.19 · Cited by 42
Self-citationCOSNet: A Cost Sensitive Neural Network for Semi-supervised Learning in Graphs
Bertoni, A., Frasca, M., & Valentini, G. (2011) · Lecture notes in computer science · doi:10.1007/978-3-642-23780-5_24 · Cited by 37
Gated Recurrent Units Based Neural Network For Tool Condition Monitoring
Xu, H., Zhang, C., Hong, G. S., Zhou, J.-H., Hong, J., & Woon, K. S. (2018) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2018.8489354 · Cited by 35
Self-citationAnalysis of an evolutionary RBFN design algorithm, CO2RBFN, for imbalanced data sets
Pérez-Godoy, M. D., Fernández, A., Rivera, A. J., & del Jesús, M. J. (2010) · Pattern Recognition Letters · doi:10.1016/j.patrec.2010.07.010 · Cited by 32
Addressing imbalanced data with argument based rule learning
Napierała, K., & Stefanowski, J. (2015) · Expert Systems with Applications · doi:10.1016/j.eswa.2015.07.076 · Cited by 29
SVM Learning from Imbalanced Data by GA Sampling for Protein Domain Prediction
Zou, S., Huang, Y., Wang, Y., Wang, J., & Zhou, C. (2008) · doi:10.1109/icycs.2008.72 · Cited by 27
Class-Dependant Resampling for Medical Applications
Rosas, R. M. V., & Sánchez, J. S. (2006) · International Conference on Machine Learning and Applications · doi:10.1109/icmla.2005.15 · Cited by 17
Tool condition monitoring in deep hole gun drilling: A data-driven approach
Hong, J., Zhou, J. H., Chan, H. L., Zhang, C., Xu, H., & Hong, G. S. (2017) · IEEE International Conference on Industrial Engineering and Engineering Management (IEEM) · doi:10.1109/ieem.2017.8290272 · Cited by 15
Self-citationMultiway analysis of EEG artifacts based on Block Term Decomposition
Goh, S. K., Abbass, H. A., Tan, K. C., Al-Mamun, A., Guan, C., & Wang, C. C. (2016) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2016.7727296 · Cited by 14
Self-citation(2007) · International Conference on Machine Learning and Applications · doi:10.1109/icmla.2007.113 · Cited by 12
Cited by
DeepSMOTE: Fusing Deep Learning and SMOTE for Imbalanced Data
Dablain, D., Krawczyk, B., & Chawla, N. V. (2023) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2021.3136503 · Cited by 591
Zhang, T., Chen, J., Li, F., Zhang, K., Lv, H., He, S., & Xu, E. (2022) · ISA Transactions · doi:10.1016/j.isatra.2021.02.042 · Cited by 571
An Improved Quantum-Inspired Differential Evolution Algorithm for Deep Belief Network
Deng, W., Liu, H., Xu, J., Zhao, H., & Song, Y. (2020) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2020.2983233 · Cited by 429
An Enhanced MSIQDE Algorithm With Novel Multiple Strategies for Global Optimization Problems
Deng, W., Xu, J., Gao, X.-Z., & Zhao, H. (2022) · IEEE Transactions on Systems, Man, and Cybernetics: Systems · doi:10.1109/tsmc.2020.3030792 · Cited by 388
Fernando, K. R. M., & Tsokos, C. P. (2022) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2020.3047335 · Cited by 329
Metadata
- Authors
- Zhang, C., Tan, K. C., Li, H., & Hong, G. S.
- Venue
- IEEE Transactions on Neural Networks and Learning Systems
- Published
- 2019-01
- Volume
- 30
- Issue
- 1
- Pages
- 109-122
- ISSN
- 2162-237X (ISSN-L)
- 2162-2388
- OpenAlex
- W2963596856
- Cited by
- 282
- References
- 62
- FWCI
- 15.14
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.