The DOI matches its Crossref record; 58 of the 58 references it cites were found in a registry or an index.
Information gain directed genetic algorithm wrapper feature selection for credit rating
Open accessAbstract
Abstract Financial credit scoring is one of the most crucial processes in the finance industry sector to be able to assess the credit-worthiness of individuals and enterprises. Various statistics-based machine learning techniques have been employed for this task. “Curse of Dimensionality” is still a significant challenge in machine learning techniques. Some research has been carried out on Feature Selection (FS) using genetic algorithm as wrapper to improve the performance of credit scoring models. However, the challenge lies in finding an overall best method in credit scoring problems and improving the time-consuming process of feature selection. In this study, the credit scoring problem is investigated through feature selection to improve classification performance. This work proposes a novel approach to feature selection in credit scoring applications, called as Information Gain Directed Feature Selection algorithm (IGDFS), which performs the ranking of features based on information gain, propagates the top m features through the GA wrapper (GAW) algorithm using three classical machine learning algorithms of KNN, Naive Bayes and Support Vector Machine (SVM) for credit scoring. The first stage of information gain guided feature selection can help reduce the computing complexity of GA wrapper, and the information gain of features selected with the IGDFS can indicate their importance to decision making. Regarding the classification accuracy, SVM accuracy is always better than KNN and NB for Baseline techniques, GAW and IGDFS. Also, we can conclude that the IGDFS achieved better performance than generic GAW, and GAW obtained better performance than the corresponding single classifiers (baseline) for almost all cases, except for the German Credit dataset, IGDFS + KNN has worse performance than generic GAW and the single classifier KNN. Removing features with low information gain could produce conflict with the original data structure for KNN, and thus affect the performance of IGDFS + KNN. Regarding the ROC performance, for the German Credit Dataset, the three classic machine learning algorithms, SVM, KNN and Naive Bayes in the wrapper of IGDFS GA obtained almost the same performance. For the Australian credit dataset and the Taiwan Credit dataset, the IGDFS + Naive Bayes achieved the largest area under ROC curves.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Scikit-learn: Machine Learning in Python
Pedregosa, F., Varoquaux, G., Gramfort, A., Michel, V., Thirion, B., Grisel, O., Blondel, M., Müller, A., Nothman, J., Louppe, G., et al. (2012) · arXiv · doi:10.48550/arxiv.1201.0490 · Cited by 71,016
LIBSVM: A library for support vector machines
Chang, C.-C., & Lin, C.-J. (2011) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/1961189.1961199 · Cited by 40,918
A training algorithm for optimal margin classifiers
Boser, B. E., Guyon, I. M., & Vapnik, V. N. (1992) · Proceedings of the fifth annual workshop on Computational learning theory · doi:10.1145/130385.130401 · Cited by 11,992
An Introduction to Genetic Algorithms
Mitchell, M. (1996) · doi:10.7551/mitpress/3927.001.0001 · Cited by 11,340
An introduction to variable and feature selection
GuyonIsabelle, & ElisseeffAndré (2003) · Journal of Machine Learning Research · doi:10.5555/944919.944968 · Cited by 7,715
An Introduction to Variable and Feature Selection.
Guyon, I., & Elisseeff, A. (2003) · Cited by 6,576
(2019) · Handbook of Machine Learning · doi:10.1142/9789811205675_0004 · Cited by 6,270
A Practical Guide to Support Vector Classication
Hsu, C., Chang, C.-C., & Lin, C. (2008) · Cited by 5,046
An Introduction to Support Vector Machines
Cristianini, N., & Shawe-Taylor, J. S. (2000) · ePrints Soton (University of Southampton) · Cited by 4,115
Selection of relevant features and examples in machine learning
Blum, A. L., & Langley, P. (1997) · Artificial Intelligence · doi:10.1016/s0004-3702(97)00063-5 · Cited by 3,298
Kennedy, J. (2011) · Encyclopedia of Machine Learning · doi:10.1007/978-0-387-30164-8_630 · Cited by 2,989
Knowledge-based analysis of microarray gene expression data by using support vector machines
Brown, M. P. S., Grundy, W. N., Lin, D., Cristianini, N., Sugnet, C. W., Furey, T. S., Ares, M., & Haussler, D. (2000) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.97.1.262 · Cited by 2,308
Feature Selection for Knowledge Discovery and Data Mining
Liu, H., & Motoda, H. (1998) · Springer eBooks · doi:10.1007/978-1-4615-5689-3 · Cited by 2,198
Srinivas, M., & Patnaik, L. M. (1994) · Computer · doi:10.1109/2.294849 · Cited by 2,180
An introduction to genetic algorithms
Nijhout, F. (1997) · Complexity · doi:10.1002/(sici)1099-0526(199705/06)2:5<39::aid-cplx8>3.0.co;2-l · Cited by 1,720
Toward optimal feature selection
Koller, D., & Sahami, M. (1996) · Cited by 1,482
Weston, J., Mukherjee, S., Chapelle, O., Pontil, M., Poggio, T., & Vapnik, V. N. (2000) · Cited by 988
Lin, S.-W., Ying, K.-C., Chen, S.-C., & Lee, Z.-J. (2008) · Expert Systems with Applications · doi:10.1016/j.eswa.2007.08.088 · Cited by 895
Statnikov, A., Aliferis, C. F., Tsamardinos, I., Hardin, D., & Levy, S. (2005) · Bioinformatics · doi:10.1093/bioinformatics/bti033 · Cited by 839
Credit scoring with a data mining approach based on support vector machines
Huang, C.-L., Chen, M.-C., & Wang, C.-J. (2007) · Expert Systems with Applications · doi:10.1016/j.eswa.2006.07.007 · Cited by 804
An experimental comparison of classification algorithms for imbalanced credit scoring data sets
Brown, I., & Mues, C. (2012) · Expert Systems with Applications · doi:10.1016/j.eswa.2011.09.033 · Cited by 730
Feature Extraction Construction and Selection: A Data Mining Perspective
MTW, Liu, H., & Motoda, H. (1999) · Journal of the American Statistical Association · doi:10.2307/2669967 · Cited by 713
Feature selection for text classification with Naïve Bayes
Chen, J., Huang, H., Tian, S., & Qu, Y. (2009) · Expert Systems with Applications · doi:10.1016/j.eswa.2008.06.054 · Cited by 576
A wrapper method for feature selection using Support Vector Machines
Maldonado, S., & Weber, R. (2009) · Information Sciences · doi:10.1016/j.ins.2009.02.014 · Cited by 473
Genetic algorithm-based heuristic for feature selection in credit risk assessment
Oreski, S., & Oreski, G. (2014) · Expert Systems with Applications · doi:10.1016/j.eswa.2013.09.004 · Cited by 430
On the relationship between feature selection and classification accuracy
Janecek, A., Gansterer, W. N., Demel, M., & Ecker, G. F. (2008) · Phaidra (Universität Wien) · Cited by 373
A hybrid genetic algorithm for feature selection wrapper based on mutual information
Huang, J., Cai, Y., & Xu, X. (2007) · Pattern Recognition Letters · doi:10.1016/j.patrec.2007.05.011 · Cited by 358
Feature selection for support vector machines by means of genetic algorithm
Frohlich, H., Chapelle, O., & Scholkopf, B. (2004) · Proceedings. 15th IEEE International Conference on Tools with Artificial Intelligence · doi:10.1109/tai.2003.1250182 · Cited by 339
Recent advances and emerging challenges of feature selection in the context of big data
Bolón-Canedo, V., Sánchez-Maroño, N., & Alonso-Betanzos, A. (2015) · Knowledge-Based Systems · doi:10.1016/j.knosys.2015.05.014 · Cited by 320
Credit scoring using the clustered support vector machine
Harris, T. (2015) · Expert Systems with Applications · doi:10.1016/j.eswa.2014.08.029 · Cited by 269
The effect of feature selection on financial distress prediction
Liang, D., Tsai, C.-F., & Wu, H.-T. (2015) · Knowledge-Based Systems · doi:10.1016/j.knosys.2014.10.010 · Cited by 233
Combination of feature selection approaches with SVM in credit scoring
Chen, F.-L., & Li, F.-C. (2010) · Expert Systems with Applications · doi:10.1016/j.eswa.2009.12.025 · Cited by 202
Kohavi, R., & John, G. H. (1998) · Feature Extraction, Construction and Selection · doi:10.1007/978-1-4615-5725-8_3 · Cited by 193
Koutanaei, F. N., Sajedi, H., & Khanbabaei, M. (2015) · Journal of Retailing and Consumer Services · doi:10.1016/j.jretconser.2015.07.003 · Cited by 178
Multiple classifier application to credit risk assessment
Twala, B. (2010) · Expert Systems with Applications · doi:10.1016/j.eswa.2009.10.018 · Cited by 166
Kim, K.-J., & Ahn, H. (2012) · Computers & Operations Research · doi:10.1016/j.cor.2011.06.023 · Cited by 165
A data driven ensemble classifier for credit scoring analysis
Hsieh, N., & Hung, L. (2009) · Expert Systems with Applications · doi:10.1016/j.eswa.2009.05.059 · Cited by 163
Cost-based feature selection for Support Vector Machines: An application in credit scoring
Maldonado, S., Pérez, J., & Bravo, C. (2017) · European Journal of Operational Research · doi:10.1016/j.ejor.2017.02.037 · Cited by 160
Zhuo, L., Zheng, J., Li, X., Wang, F., Ai, B., & Qian, J. (2008) · Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE · doi:10.1117/12.813256 · Cited by 138
Li, L., Jiang, W., Li, X., Moser, K. L., Guo, Z., Du, L., Wang, Q., Topol, E. J., Wang, Q. K., & Rao, S. (2004) · Genomics · doi:10.1016/j.ygeno.2004.09.007 · Cited by 133
Feature selection in corporate credit rating prediction
Hájek, P., & Michalak, K. (2013) · Knowledge-Based Systems · doi:10.1016/j.knosys.2013.07.008 · Cited by 125
Data mining feature selection for credit scoring models
Liu, Y., & Schümann, M. (2005) · Journal of the Operational Research Society · doi:10.1057/palgrave.jors.2601976 · Cited by 125
DWFS: A Wrapper Feature Selection Tool Based on a Parallel Genetic Algorithm
Soufan, O., Kleftogiannis, D., Kalnis, P., & Bajić, V. B. (2015) · PLoS ONE · doi:10.1371/journal.pone.0117988 · Cited by 121
Hens, A. B., & Tiwari, M. K. (2012) · Expert Systems with Applications · doi:10.1016/j.eswa.2011.12.057 · Cited by 107
Information Gain, Correlation and Support Vector Machines
Roobaert, D., Karakoulas, G. J., & Chawla, N. V. (2008) · Studies in fuzziness and soft computing · doi:10.1007/978-3-540-35488-8_23 · Cited by 105
Yu, L., Yao, X., Wang, S., & Lai, K. K. (2011) · Expert Systems with Applications · doi:10.1016/j.eswa.2011.06.023 · Cited by 97
Rough set and scatter search metaheuristic based feature selection for credit scoring
Wang, J., Hedar, A.-R., Wang, S., & Ma, J. (2011) · Expert Systems with Applications · doi:10.1016/j.eswa.2011.11.011 · Cited by 85
Global geometric similarity scheme for feature selection in fault diagnosis
Liu, C., Jiang, D., & Yang, W. (2013) · Expert Systems with Applications · doi:10.1016/j.eswa.2013.11.037 · Cited by 58
Filter- versus wrapper-based feature selection for credit scoring
Somol, P., Baesens, B., Pudil, P., & Vanthienen, J. (2005) · International Journal of Intelligent Systems · doi:10.1002/int.20103 · Cited by 54
Chen, Z., Lin, T., Tang, N., & Xia, X. (2016) · Scientific Programming · doi:10.1155/2016/2739621 · Cited by 51
El-Alfy, E.-S. M., & Alshammari, M. A. (2016) · Simulation Modelling Practice and Theory · doi:10.1016/j.simpat.2016.01.010 · Cited by 44
Kimovski, D., Ortega, J., Ortíz, A., & Baños, R. (2015) · Expert Systems with Applications · doi:10.1016/j.eswa.2015.01.061 · Cited by 38
Ha, V.-S., Nam, N. H., & Nhan, N. D. (2016) · Indian Journal of Science and Technology · doi:10.17485/ijst/2016/v9i20/92299 · Cited by 35
Combination of Feature Selection and Optimized Fuzzy Apriori Rules: The Case of Credit Scoring
Sadatrasoul, S. M., Gholamian, M. R., & Shahanaghi, K. (2015) · The International Arab Journal of Information Technology · Cited by 25
A Genetic Algorithm:Neural Network Wrapper Approach for Bundle Branch Block Detection
Allami, R., Stranieri, A., Jelinek, H. F., & Balasubramanian, V. (2016) · Computing in cardiology · doi:10.22489/cinc.2016.132-174 · Cited by 19
An academic review: applications of data mining techniques in finance industry
Jadhav, S., He, H., & Jenkins, K. W. (2017) · CERES (Cranfield University) · Cited by 13
Self-citationAn Integrated Genetic-Based Model of Naive Bayes Networks for Credit Scoring
Hamadani, A. Z., Shalbafzadeh, A., Rezvan, M. T., & Moghadam, A. (2013) · International Journal of Artificial Intelligence & Applications · doi:10.5121/ijaia.2013.4107 · Cited by 12
FRFE: Fast Recursive Feature Elimination for Credit Scoring
Ha, V.-S., & Nguyen, H.-N. (2016) · Lecture notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering · doi:10.1007/978-3-319-46909-6_13 · Cited by 9
Cited by
Statistical and machine learning models in credit scoring: A systematic literature survey
Dastile, X., Celik, T., & Potsane, M. (2020) · Applied Soft Computing · doi:10.1016/j.asoc.2020.106263 · Cited by 404
Hu, J., Chen, H., Heidari, A. A., Wang, M., Zhang, X., Chen, Y., & Pan, Z. (2021) · Knowledge-Based Systems · doi:10.1016/j.knosys.2020.106684 · Cited by 289
Metadata
- Authors
- Jadhav, S., He, H., & Jenkins, K.
- Venue
- Applied Soft Computing
- Publisher
- Elsevier BV
- Published
- 2018-08
- Volume
- 69
- Pages
- 541-553
- ISSN
- 1568-4946 (ISSN-L)
- OpenAlex
- W2799791930
- Cited by
- 300
- References
- 58
- FWCI
- 77.25
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.