Benchmarking state-of-the-art classification algorithms for credit scoring
The DOI matches its Crossref record; 33 of the 33 references it cites were found in a registry or an index.
Abstract
In this paper, we study the performance of various state-of-the-art classification algorithms applied to eight real-life credit scoring data sets. Some of the data sets originate from major Benelux and UK financial institutions. Different types of classifiers are evaluated and compared. Besides the well-known classification algorithms (eg logistic regression, discriminant analysis, k-nearest neighbour, neural networks and decision trees), this study also investigates the suitability and performance of some recently proposed, advanced kernel-based classification algorithms such as support vector machines and least-squares support vector machines (LS-SVMs). The performance is assessed using the classification accuracy and the area under the receiver operating characteristic curve. Statistically significant performance differences are identified using the appropriate test statistics. It is found that both the LS-SVM and neural network classifiers yield a very good performance, but also simple classifiers such as logistic regression and linear discriminant analysis perform very well for credit scoring.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Many benchmarking studies have illustrated that complex analytical techniques only provide marginal performance gains on structured, tabular data sets as frequently encountered in common classification tasks such as fraud detection, credit scoring and marketing analytics (Baesens et al., 2003; Lessmann et al., 2015).”
From Data engineering for fraud detection (2021) · cites this paper as Baesens et al., 2003
In the citing paper
“We would also like to note that these complex models not always significantly outperform simple analytical models such as logistic regression (Baesens et al., 2003; Lessmann et al., 2015)”
From Data engineering for fraud detection (2021) · cites this paper as Baesens et al., 2003
Citations
Cites
Wu, Y. (1999) · Technometrics · doi:10.1080/00401706.1999.10485951 · Cited by 27,221
The Elements of Statistical Learning
Hastie, T., Tibshirani, R., & Friedman, J. (2009) · Springer Series in Statistics · doi:10.1007/978-0-387-84858-7 · Cited by 25,970
(1992) · Cited by 23,431
DeLong, E. R., DeLong, D. M., & Clarke-Pearson, D. L. (1988) · Biometrics · doi:10.2307/2531595 · Cited by 22,649
Neural networks for pattern recognition
(1994) · Choice Reviews Online · doi:10.5860/choice.31-5500 · Cited by 18,538
The Elements of Statistical Learning: Data Mining, Inference, and Prediction
John Lu, Z. Q. (2010) · Journal of the Royal Statistical Society Series A: Statistics in Society · doi:10.1111/j.1467-985x.2010.00646_6.x · Cited by 12,390
Neural Networks for Pattern Recognition
Bishop, C. M. (1995) · doi:10.1093/oso/9780198538493.001.0001 · Cited by 12,287
Least Squares Support Vector Machine Classifiers
Suykens, J. A. K., & Vandewalle, J. (1999) · Neural Processing Letters · doi:10.1023/a:1018628609742 · Cited by 9,362
Self-citationFriedman, N., Geiger, D., & Goldszmidt, M. (1997) · Machine Learning · doi:10.1023/a:1007465528199 · Cited by 4,742
Handbook of Parametric and Nonparametric Statistical Procedures
(2004) · Technometrics · doi:10.1198/tech.2004.s209 · Cited by 4,661
Research works printed but not linked: 3
- Henley WE, 1997, IMA J Math Appl Bus Ind, 8, 305
- Yobas MB, 2000, IMA J Math Appl Bus Ind, 11, 111
- Banasik J, 1996, Int Rev Ret Dis Cons Res, 6, 180
Cited by
Benchmarking state-of-the-art classification algorithms for credit scoring: an update of research
Lessmann, S., Baesens, B., Seow, H.-V., & Thomas, L. C. (2015) · European Journal of Operational Research · doi:10.1016/j.ejor.2015.05.030 · Cited by 1,284
“We pay special attention to ensemble classifiers, which Baesens, et al. (2003) do not cover.”
BackgroundMethodResultInfluentialSelf-citationLessmann, S., Baesens, B., Mues, C., & Pietsch, S. (2008) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2008.35 · Cited by 1,226
“It is known that a careful tuning of such hyperparameters is essential to obtain a representative assessment of the classifier’s potential (see, e.g., [3], [63]).”
BackgroundSelf-citationYeh, I.-C., & Lien, C.-H. (2009) · Expert Systems with Applications · doi:10.1016/j.eswa.2007.12.020 · Cited by 885
“Baesens et al. (2003) found that, based on eight real-life credit scoring data sets, both the LS-SVM and neural network classifiers yield a very good performance, but also simple classifiers such as logistic regression and linear discriminant analysis perform very well for credit scoring.”
BackgroundCredit scoring with a data mining approach based on support vector machines
Huang, C.-L., Chen, M.-C., & Wang, C.-J. (2007) · Expert Systems with Applications · doi:10.1016/j.eswa.2006.07.007 · Cited by 804
A boosted decision tree approach using Bayesian hyper-parameter optimization for credit scoring
Xia, Y., Liu, C., Li, Y., & Liu, N. (2017) · Expert Systems with Applications · doi:10.1016/j.eswa.2017.02.017 · Cited by 769
“SVM requires appropriate tuning of parameters (Huang et al., 2007), and tasks are AC CE PT ED M AN US CR IP T handled by GS (Baesens et al., 2003).”
Method
Metadata
- Authors
- Baesens, B., Van Gestel, T., Viaene, S., Stepanova, M., Suykens, J., & Vanthienen, J.
- Affiliations
- KU Leuven (BE)
- K.U.Leuven Leuven Belgium
- Union Bank of Switzerland (CH)
- Corresponding author
- Baesens, B
- Viaene, S
- Venue
- Journal of the Operational Research Society
- Publisher
- Informa UK Limited
- Published
- 2003-06
- Volume
- 54
- Issue
- 6
- Pages
- 627-635
- ISSN
- 0160-5682 (ISSN-L)
- 1476-9360
- OpenAlex
- W1982120517
- Cited by
- 904
- References
- 33
- Citations by year
- 2026: 54 · 2025: 51 · 2024: 41 · 2023: 52 · 2022: 60 · 2021: 42 · 2020: 57 · 2019: 65 · 2018: 41 · 2017: 42 · 2016: 45 · 2015: 43 · 2014: 26 · 2013: 25 · 2012: 35
- FWCI
- 50.33
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Journal of the Operational Research Society (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- ePrints Soton (University of Southampton) (submittedVersion)
- Topics
- Social Sciences › Business, Management and Accounting › Accounting › Financial Distress and Bankruptcy Prediction
- Physical Sciences › Computer Science › Artificial Intelligence › Imbalanced Data Classification Techniques
- Physical Sciences › Computer Science › Information Systems › Data Mining and Machine Learning Applications
- Keywords
- credit scoring, machine learning classifiers, benchmarking, support vector machine, least squares support vector machine, artificial neural networks, logistic regression, linear discriminant analysis, k-nearest neighbors, decision tree, kernel-based classifiers, credit risk
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Benchmarking state-of-the-art classification algorithms for credit scoring. https://app.cochat.ai/papers/10.1057/palgrave.jors.2601545
- The paper
- Baesens, B., Van Gestel, T., Viaene, S., Stepanova, M., Suykens, J., & Vanthienen, J. (2003). Benchmarking state-of-the-art classification algorithms for credit scoring. Journal of the Operational Research Society. https://doi.org/10.1057/palgrave.jors.2601545
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.