The DOI matches its Crossref record; 58 of the 58 references it cites were found in a registry or an index.
Machine learning for credit scoring: Improving logistic regression with non-linear decision-tree effects
Open accessAbstract
In the context of credit scoring, ensemble methods based on decision trees, such as the random forest method, provide better classification performance than standard logistic regression models. However, logistic regression remains the benchmark in the credit risk industry mainly because the lack of inter-pretability of ensemble methods is incompatible with the requirements of financial regulators. In this paper, we propose a high-performance and interpretable credit scoring method called penalised logistic tree regression (PLTR), which uses information from decision trees to improve the performance of logistic regression. Formally, rules extracted from various short-depth decision trees built with original predictive variables are used as predictors in a penalised logistic regression model. PLTR allows us to capture non-linear effects that can arise in credit scoring data while preserving the intrinsic interpretability of the logistic regression model. Monte Carlo simulations and empirical applications using four real credit default datasets show that PLTR predicts credit risk significantly more accurately than logistic regression and compares competitively to the random forest method.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Breiman, L. (2001) · Machine Learning · doi:10.1023/a:1010933404324 · Cited by 133,538
Regression shrinkage and selection via the lasso
Tibshirani, R. (1996) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1996.tb02080.x · Cited by 51,482
A Unified Approach to Interpreting Model Predictions
Lundberg, S., & Lee, S.-I. (2017) · arXiv · doi:10.48550/arxiv.1705.07874 · Cited by 23,707
Regularization and Variable Selection Via the Elastic Net
Zou, H., & Hastie, T. (2005) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.1467-9868.2005.00503.x · Cited by 20,957
Regularization Paths for Generalized Linear Models via Coordinate Descent
Friedman, J., Hastie, T., & Tibshirani, R. (2010) · Journal of Statistical Software · doi:10.18637/jss.v033.i01 · Cited by 19,927
Breiman, L. (1996) · Machine Learning · doi:10.1007/bf00058655 · Cited by 16,325
FINANCIAL RATIOS, DISCRIMINANT ANALYSIS AND THE PREDICTION OF CORPORATE BANKRUPTCY
Altman, E. I. (1968) · The Journal of Finance · doi:10.1111/j.1540-6261.1968.tb00843.x · Cited by 14,888
Gauriat, C.-M., Pencolé, Y., Ribot, P., & Brouillet, G. (2024) · HAL (Le Centre pour la Communication Scientifique Directe) · doi:10.4230/oasics.dx.2024.27 · Cited by 12,586
Ridge regression: Biased estimation for nonorthogonal problems
Hoerl, A. E., & Kennard, R. W. (1970) · Technometrics · doi:10.1080/00401706.1970.10488634 · Cited by 9,648
Variable Selection via Nonconcave Penalized Likelihood and its Oracle Properties
Fan, J., & Li, R. (2001) · Journal of the American Statistical Association · doi:10.1198/016214501753382273 · Cited by 8,900
The adaptive lasso and its oracle properties
Zou, H. (2006) · Journal of the American Statistical Association · doi:10.1198/016214506000000735 · Cited by 7,470
Diebold, F., & Mariano, R. (1994) · National Bureau of Economic Research · doi:10.3386/t0169 · Cited by 5,185
Diebold, F. X., & Mariano, R. S. (1995) · Journal of Business & Economic Statistics · doi:10.1080/07350015.1995.10524599 · Cited by 5,130
Approximate Statistical Tests for Comparing Supervised Classification Learning Algorithms
Dietterich, T. G. (1998) · Neural Computation · doi:10.1162/089976698300017197 · Cited by 3,840 · cited 2×
“For this, we used the so-called N × 2-fold cross-validation by following Dietterich (1998). We randomly divide the data set in two sub-samples of equal size.”
MethodTowards A Rigorous Science of Interpretable Machine Learning
Doshi-Velez, F., & Kim, B. (2017) · arXiv · doi:10.48550/arxiv.1702.08608 · Cited by 3,121
On the Uniform Convergence of Relative Frequencies of Events to Their Probabilities
Vapnik, V. N., & Chervonenkis, A. Y. (2015) · Measures of Complexity · doi:10.1007/978-3-319-21852-6_3 · Cited by 3,105
On the Uniform Convergence of Relative Frequencies of Events to Their Probabilities
Vapnik, V. N., & Chervonenkis, A. Y. (1971) · Theory of Probability & Its Applications · doi:10.1137/1116025 · Cited by 2,448
An Introduction to the Conjugate Gradient Method Without the Agonizing Pain
Shewchuk, J. R. (1994) · Cited by 2,173
(2011) · Econometrica · doi:10.3982/ecta5771 · Cited by 2,096
Machine Learning: An Applied Econometric Approach
Mullainathan, S., & Spiess, J. (2017) · Journal of Economic Perspectives · doi:10.1257/jep.31.2.87 · Cited by 1,989
Benchmarking state-of-the-art classification algorithms for credit scoring: an update of research
Lessmann, S., Baesens, B., Seow, H.-V., & Thomas, L. C. (2015) · European Journal of Operational Research · doi:10.1016/j.ejor.2015.05.030 · Cited by 1,284
Landwehr, N., Hall, M., & Frank, E. (2005) · Machine Learning · doi:10.1007/s10994-005-0466-3 · Cited by 1,214
Managerial Applications of Neural Networks: The Case of Bank Failure Predictions
Tam, K. Y., & Kiang, M. Y. (1992) · Management Science · doi:10.1287/mnsc.38.7.926 · Cited by 1,118
Interpretable Machine Learning
Molnar, C. (2020) · Cited by 1,104
Neural network credit scoring models
West, D. (2000) · Computers & Operations Research · doi:10.1016/s0305-0548(99)00149-5 · Cited by 1,033
Benchmarking state-of-the-art classification algorithms for credit scoring
Baesens, B., Van Gestel, T., Viaene, S., Stepanova, M., Suykens, J., & Vanthienen, J. (2003) · Journal of the Operational Research Society · doi:10.1057/palgrave.jors.2601545 · Cited by 904
L 1-Regularization Path Algorithm for Generalized Linear Models
Park, M. Y., & Hastie, T. (2007) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.1467-9868.2007.00607.x · Cited by 838
Ridge Regression: Biased Estimation for Nonorthogonal Problems
Hoerl, A. E., & Kennard, R. W. (2000) · Technometrics · doi:10.1080/00401706.2000.10485983 · Cited by 808
A survey of credit and behavioural scoring: forecasting financial risk of lending to consumers
Thomas, L. C. (2000) · International Journal of Forecasting · doi:10.1016/s0169-2070(00)00034-0 · Cited by 741
Credit Scoring and Its Applications
Thomas, L. C., Edelman, D. B., & Crook, J. N. (2002) · Society for Industrial and Applied Mathematics eBooks · doi:10.1137/1.9780898718317 · Cited by 667
Adaptive Lasso for Cox's proportional hazards model
Zhang, H. H., & Lu, W. (2007) · Biometrika · doi:10.1093/biomet/asm037 · Cited by 644
BigTech and the changing structure of financial intermediation
Frost, J., Gambacorta, L., Huang, Y., Shin, H. S., & Zbinden, P. (2019) · Economic Policy · doi:10.1093/epolic/eiaa003 · Cited by 584
De Caigny, A., Coussement, K., & De Bock, K. W. (2018) · European Journal of Operational Research · doi:10.1016/j.ejor.2018.02.009 · Cited by 524
A comparison of neural networks and linear scoring models in the credit union environment
Desai, V. S., Crook, J. N., & Overstreet, G. A. (1996) · European Journal of Operational Research · doi:10.1016/0377-2217(95)00246-4 · Cited by 522
Explainable Machine Learning in Credit Risk Management
Bussmann, N., Giudici, P., Marinelli, D., & Papenbrock, J. (2021) · Computational Economics · doi:10.1007/s10614-020-10042-0 · Cited by 503
Credit Scoring and Its Applications
Thomas, L. C., Crook, J. N., & Edelman, D. B. (2017) · Cited by 308
A k-Nearest-Neighbour Classifier for Assessing Consumer Credit Risk
Henley, W. E., & Hand, D. J. (1996) · The Statistician · doi:10.2307/2348414 · Cited by 286
Interpreting tree ensembles with inTrees
Deng, H. (2019) · International Journal of Data Science and Analytics · doi:10.1007/s41060-018-0144-8 · Cited by 253
Akkoç, S. (2012) · European Journal of Operational Research · doi:10.1016/j.ejor.2012.04.009 · Cited by 241
Óskarsdóttir, M., Bravo, C., Sarraute, C., Vanthienen, J., & Baesens, B. (2019) · Applied Soft Computing · doi:10.1016/j.asoc.2018.10.004 · Cited by 215
Subagging for credit scoring models
Paleologo, G., Elisseeff, A., & Antonini, G. (2010) · European Journal of Operational Research · doi:10.1016/j.ejor.2009.03.008 · Cited by 213
Multiple classifier architectures and their application to credit risk assessment
Finlay, S. (2011) · European Journal of Operational Research · doi:10.1016/j.ejor.2010.09.029 · Cited by 209
Verbraken, T., Bravo, C., Weber, R., & Baesens, B. (2014) · European Journal of Operational Research · doi:10.1016/j.ejor.2014.04.001 · Cited by 179
Decompositional Rule Extraction from Support Vector Machines by Active Learning
Martens, D., Baesens, B. B., & Van Gestel, T. (2009) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2008.131 · Cited by 179
Machine Learning Explainability in Finance: An Application to Default Risk Analysis
Bracke, P., Datta, A., Jung, C., & Sen, S. (2019) · SSRN Electronic Journal · doi:10.2139/ssrn.3435104 · Cited by 172
Credit Granting: A Comparative Analysis of Classification Procedures
SRINIVASAN, V., & KIM, Y. H. (1987) · The Journal of Finance · doi:10.1111/j.1540-6261.1987.tb04576.x · Cited by 163
LOTUS: An Algorithm for Building Accurate and Comprehensible Logistic Regression Trees
Chan, K.-Y., & Loh, W. (2004) · Journal of Computational and Graphical Statistics · doi:10.1198/106186004x13064 · Cited by 154
Credit scoring using neural and evolutionary techniques
Yobas, M. B. (2000) · IMA Journal of Management Mathematics · doi:10.1093/imaman/11.2.111 · Cited by 151
Recursive Neural Network Rule Extraction for Data With Mixed Attributes
Setiono, R., Baesens, B., & Mues, C. (2008) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2007.908641 · Cited by 142
Good practice in retail credit scorecard assessment
Hand, D. J. (2005) · Journal of the Operational Research Society · doi:10.1057/palgrave.jors.2601932 · Cited by 119
Candelon, B., Dumitrescu, E., & Christophe Hurlin, Y. (2012) · IMF Economic Review · doi:10.1057/imfer.2012.4 · Cited by 116
Self-citationData Mining Using SAS® Enterprise Miner™
Matignon, R. (2007) · Wiley eBooks · doi:10.1002/9780470171431 · Cited by 113
Construction of a k-nearest-neighbour credit-scoring system
Henley, W. (1997) · IMA Journal of Management Mathematics · doi:10.1093/imaman/8.4.305 · Cited by 96
Cost-sensitive learning and decision making revisited
Viaene, S., & Dedene, G. (2004) · European Journal of Operational Research · doi:10.1016/j.ejor.2004.03.031 · Cited by 68
Predicting Bankruptcy in Private Firms: Towards a Stepwise Regression Procedure
Bauweraerts, J. (2016) · International Journal of Financial Research · doi:10.5430/ijfr.v7n2p147 · Cited by 34
Machine learning et nouvelles sources de données pour le scoring de crédit
Christophe Hurlin, Y., & Pérignon, C. (2020) · Revue d économie financière · doi:10.3917/ecofi.135.0021 · Cited by 12
Verification of forecasts expressed in terms of probability
BRIER, G. W. (1950) · Monthly Weather Review · doi:10.1175/1520-0493(1950)078%3c0001:vofeit%3e2.0.co;2 · cited 4×
“Lastly, the Brier Score (Brier, 1950) is defined as”
MethodInfluentialVERIFICATION OF FORECASTS EXPRESSED IN TERMS OF PROBABILITY
BRIER, G. W. (1950) · Monthly Weather Review · doi:10.1175/1520-0493(1950)078<0001:vofeit>2.0.co;2
Cited by
Explainable artificial intelligence (XAI) in finance: a systematic literature review
Černevičienė, J., & Kabašinskas, A. (2024) · Artificial Intelligence Review · doi:10.1007/s10462-024-10854-8 · Cited by 289
Interpretable machine learning for imbalanced credit scoring datasets
Chen, Y., Calabrese, R., & Martin-Barragan, B. (2024) · European Journal of Operational Research · doi:10.1016/j.ejor.2023.06.036 · Cited by 190
Interpretable generalized additive neural networks
Kraus, M., Tschernutter, D., Weinzierl, S., & Zschech, P. (2024) · European Journal of Operational Research · doi:10.1016/j.ejor.2023.06.032 · Cited by 59
Yang, S., & Liu, X. (2026) · Journal of King Saud University Computer and Information Sciences · doi:10.1007/s44443-026-00904-2
Metadata
- Authors
- Dumitrescu, E., Hué, S., Hurlin, C., & Tokpavi, S.
- Venue
- European Journal of Operational Research
- Publisher
- Elsevier BV
- Published
- 2022-03
- Volume
- 297
- Issue
- 3
- Pages
- 1178-1192
- ISSN
- 0377-2217 (ISSN-L)
- OpenAlex
- W3173725123
- Cited by
- 430
- References
- 58
- FWCI
- 98.35
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.