The DOI matches its Crossref record; 33 of the 33 references it cites were found in a registry or an index.
An experimental comparison of classification algorithms for imbalanced credit scoring data sets
Open accessAbstract
In this paper, we set out to compare several techniques that can be used in the analysis of imbalanced credit scoring data sets. In a credit scoring context, imbalanced data sets frequently occur as the number of defaulting loans in a portfolio is usually much lower than the number of observations that do not default. As well as using traditional classification techniques such as logistic regression, neural networks and decision trees, this paper will also explore the suitability of gradient boosting, least square support vector machines and random forests for loan default prediction. Five real-world credit scoring data sets are used to build classifiers and test their performance. In our experiments, we progressively increase class imbalance in each of these data sets by randomly under-sampling the minority class of defaulters, so as to identify to what extent the predictive power of the respective techniques is adversely affected. The performance criterion chosen to measure this effect is the area under the receiver operating characteristic curve (AUC); Friedman’s statistic and Nemenyi post hoc tests are used to test for significance of AUC differences between techniques. The results from this empirical study indicate that the random forest and gradient boosting classifiers perform very well in a credit scoring context and are able to cope comparatively well with pronounced class imbalances in these data sets. We also found that, when faced with a large class imbalance, the C4.5 decision tree algorithm, quadratic discriminant analysis and k-nearest neighbours perform significantly worse than the best performing classifiers.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Breiman, L. (2001) · Machine Learning · doi:10.1023/a:1010933404324 · Cited by 133,538
(1990) · Choice Reviews Online · doi:10.5860/choice.27-3338 · Cited by 35,305
SMOTE synthetic minority over-sampling technique
Chawla, N. V., Bowyer, K. W., Hall, L. O., & Kegelmeyer, W. P. (2002) · Journal of Artificial Intelligence Research · doi:10.1613/jair.953 · Cited by 32,865
Greedy function approximation: A gradient boosting machine
Friedman, J. H. (2001) · The Annals of Statistics · doi:10.1214/aos/1013203451 · Cited by 30,731
The Elements of Statistical Learning
Hastie, T., Tibshirani, R., & Friedman, J. (2009) · Springer Series in Statistics · doi:10.1007/978-0-387-84858-7 · Cited by 25,970
Data Mining: Practical Machine Learning Tools and Techniques
(2011) · Elsevier eBooks · doi:10.1016/c2009-0-19715-5 · Cited by 25,437
(1992) · Cited by 23,431
DeLong, E. R., DeLong, D. M., & Clarke-Pearson, D. L. (1988) · Biometrics · doi:10.2307/2531595 · Cited by 22,649
Hosmer, D. W., & Lemeshow, S. (2000) · doi:10.1002/0471722146 · Cited by 20,302
Neural networks for pattern recognition
(1994) · Choice Reviews Online · doi:10.5860/choice.31-5500 · Cited by 18,538
FINANCIAL RATIOS, DISCRIMINANT ANALYSIS AND THE PREDICTION OF CORPORATE BANKRUPTCY
Altman, E. I. (1968) · The Journal of Finance · doi:10.1111/j.1540-6261.1968.tb00843.x · Cited by 14,888
The Elements of Statistical Learning: Data Mining, Inference, and Prediction
John Lu, Z. Q. (2010) · Journal of the Royal Statistical Society Series A: Statistics in Society · doi:10.1111/j.1467-985x.2010.00646_6.x · Cited by 12,390
Neural Networks for Pattern Recognition
Bishop, C. M. (1995) · doi:10.1093/oso/9780198538493.001.0001 · Cited by 12,287
Friedman, J. H. (2002) · Computational Statistics & Data Analysis · doi:10.1016/s0167-9473(01)00065-2 · Cited by 7,067
A study of the behavior of several methods for balancing machine learning training data
Batista, G. E. A. P. A., Prati, R. C., & Monard, M. C. (2004) · ACM SIGKDD Explorations Newsletter · doi:10.1145/1007730.1007735 · Cited by 4,203
Least Squares Support Vector Machines
Suykens, J. A. K., Van Gestel, T., De Brabanter, J., De Moor, B., & Vandewalle, J. (2002) · WORLD SCIENTIFIC eBooks · doi:10.1142/5089 · Cited by 3,642
A Comparison of Alternative Tests of Significance for the Problem of $m$ Rankings
Friedman, M. (1940) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177731944 · Cited by 2,785
Lessmann, S., Baesens, B., Mues, C., & Pietsch, S. (2008) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2008.35 · Cited by 1,226
Self-citationLeast Squares Support Vector Machines
Suykens, J. A. K., Gestel, T. V., Brabanter, J. D., Moor, B. D., & Vandewalle, J. P. L. (2002) · WORLD SCIENTIFIC eBooks · doi:10.1142/9789812776655 · Cited by 1,166
Statistical Comparisons of Classifiers over Multiple Data Sets
DemšarJanez (2006) · Journal of Machine Learning Research · doi:10.5555/1248547.1248548 · Cited by 1,074
Altman, E. I., Marco, G., & Varetto, F. (1994) · Journal of Banking & Finance · doi:10.1016/0378-4266(94)90007-8 · Cited by 1,059
Neural network credit scoring models
West, D. (2000) · Computers & Operations Research · doi:10.1016/s0305-0548(99)00149-5 · Cited by 1,033
Learning when training data are costly: the effect of class distribution on tree induction
Weiss, G. M., & Provost, F. (2003) · Journal of Artificial Intelligence Research · doi:10.1613/jair.1199 · Cited by 921
Benchmarking state-of-the-art classification algorithms for credit scoring
Baesens, B., Van Gestel, T., Viaene, S., Stepanova, M., Suykens, J., & Vanthienen, J. (2003) · Journal of the Operational Research Society · doi:10.1057/palgrave.jors.2601545 · Cited by 904
A comparison of neural networks and linear scoring models in the credit union environment
Desai, V. S., Crook, J. N., & Overstreet, G. A. (1996) · European Journal of Operational Research · doi:10.1016/0377-2217(95)00246-4 · Cited by 522
Learning from Imbalanced Data Sets: A Comparison of Various Strategies *
Japkowicz, N. (2000) · Cited by 455
A Note on the Comparison of Logit and Discriminant Models of Consumer Credit Behavior
Wiginton, J. C. (1980) · The Journal of Financial and Quantitative Analysis · doi:10.2307/2330408 · Cited by 435
Efficient progressive sampling
Provost, F., Jensen, D., & Oates, T. (1999) · Proceedings of the fifth ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/312129.312188 · Cited by 357
A credit scoring model for personal loans
Steenackers, A., & Goovaerts, M. J. (1989) · Insurance Mathematics and Economics · doi:10.1016/0167-6687(89)90044-9 · Cited by 152
Credit scoring using neural and evolutionary techniques
Yobas, M. B. (2000) · IMA Journal of Management Mathematics · doi:10.1093/imaman/11.2.111 · Cited by 151
Construction of a k-nearest-neighbour credit-scoring system
Henley, W. (1997) · IMA Journal of Management Mathematics · doi:10.1093/imaman/8.4.305 · Cited by 96
Adaptive credit scoring with kernel learning methods
Yang, Y. (2007) · European Journal of Operational Research · doi:10.1016/j.ejor.2006.10.066 · Cited by 76
A Nonparametric Approach to Credit Screening
Chatterjee, S., & Barcun, S. (1970) · Journal of the American Statistical Association · doi:10.1080/01621459.1970.10481068 · Cited by 60
Cited by
A comparative analysis of gradient boosting algorithms
Bentéjac, C., Csörgő, A., & Martínez-Muñoz, G. (2021) · Artificial Intelligence Review · doi:10.1007/s10462-020-09896-5 · Cited by 2,998
Learning from class-imbalanced data: Review of methods and applications
Haixiang, G., Yijing, L., Shang, J., Mingyun, G., Yuanyue, H., & Bing, G. (2017) · Expert Systems with Applications · doi:10.1016/j.eswa.2016.12.035 · Cited by 2,377
Benchmarking state-of-the-art classification algorithms for credit scoring: an update of research
Lessmann, S., Baesens, B., Seow, H.-V., & Thomas, L. C. (2015) · European Journal of Operational Research · doi:10.1016/j.ejor.2015.05.030 · Cited by 1,284
A boosted decision tree approach using Bayesian hyper-parameter optimization for credit scoring
Xia, Y., Liu, C., Li, Y., & Liu, N. (2017) · Expert Systems with Applications · doi:10.1016/j.eswa.2017.02.017 · Cited by 769
Chen, K., Chen, H., Zhou, C., Huang, Y., Qi, X., Shen, R., Liu, F., Zuo, M., Zou, X., Wang, J., et al. (2020) · Water Research · doi:10.1016/j.watres.2019.115454 · Cited by 580
Metadata
- Authors
- Brown, I., & Mues, C.
- Venue
- Expert Systems with Applications
- Publisher
- Elsevier BV
- Published
- 2012-02
- Volume
- 39
- Issue
- 3
- Pages
- 3446-3453
- ISSN
- 0957-4174 (ISSN-L)
- OpenAlex
- W2052611008
- Cited by
- 730
- References
- 33
- FWCI
- 8.28
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.