The DOI matches its Crossref record; 68 of the 71 references it cites were found in a registry or an index.
Interpretable machine learning for imbalanced credit scoring datasets
Open accessAbstract
The class imbalance problem is common in the credit scoring domain, as the number of defaulters is usually much less than the number of non-defaulters. To date, research on investigating the class imbalance problem has mainly focused on indicating and reducing the adverse effect of the class imbalance on the predictive accuracy of machine learning techniques, while the impact of that on machine learning interpretability has never been studied in the literature. This paper fills this gap by analysing how the stability of Local Interpretable Model-agnostic Explanations (LIME) and SHapley Additive exPlanations (SHAP), two popular interpretation methods, are affected by class imbalance. Our experiments use 2016-2020 UK residential mortgage data collected from European Datawarehouse. We evaluate the stability of LIME and SHAP on datasets of progressively increased class imbalance. The results show that interpretations generated from LIME and SHAP are less stable as the class imbalance increases, which indicates that the class imbalance does have an adverse effect on machine learning interpretability. To check the robustness of our outcomes, we also analyse two open-source credit scoring datasets and we obtain similar results.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
SMOTE synthetic minority over-sampling technique
Chawla, N. V., Bowyer, K. W., Hall, L. O., & Kegelmeyer, W. P. (2002) · Journal of Artificial Intelligence Research · doi:10.1613/jair.953 · Cited by 32,865
Greedy function approximation: A gradient boosting machine
Friedman, J. H. (2001) · The Annals of Statistics · doi:10.1214/aos/1013203451 · Cited by 30,731
A Unified Approach to Interpreting Model Predictions
Lundberg, S., & Lee, S.-I. (2017) · arXiv · doi:10.48550/arxiv.1705.07874 · Cited by 23,707
From local explanations to global understanding with explainable AI for trees
Lundberg, S. M., Erion, G., Chen, H., DeGrave, A., Prutkin, J. M., Nair, B., Katz, R., Himmelfarb, J., Bansal, N., & Lee, S.-I. (2020) · Nature Machine Intelligence · doi:10.1038/s42256-019-0138-9 · Cited by 10,551
He, H., & Garcia, E. A. (2009) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2008.239 · Cited by 10,359
XGBoost: A Scalable Tree Boosting System
Chen, T., & Guestrin, C. (2016) · arXiv · doi:10.48550/arxiv.1603.02754 · Cited by 7,104
17. A Value for n-Person Games
Shapley, L. S. (1953) · Contributions to the Theory of Games (AM-28), Volume II · doi:10.1515/9781400881970-018 · Cited by 6,950
“Why Should I Trust You?”: Explaining the Predictions of Any Classifier
Ribeiro, M., Singh, S., & Guestrin, C. (2016) · Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Demonstrations · doi:10.18653/v1/n16-3020 · Cited by 6,682
Proceedings of the 21st International Conference on Neural Information Processing Systems
Koller, D., Schuurmans, D., Bengio, Y., & Bottou, L. (2008) · Cited by 4,461
Logistic Regression in Rare Events Data
King, G., & Zeng, L. (2001) · Political Analysis · doi:10.1093/oxfordjournals.pan.a004868 · Cited by 4,316
Learning from class-imbalanced data: Review of methods and applications
Haixiang, G., Li, Y., Shang, J. S., Gu, M., Huang, Y., & Bing, G. (2016) · Expert Systems with Applications · doi:10.1016/j.eswa.2016.12.035 · Cited by 2,508
Learning from imbalanced data: open challenges and future directions
Krawczyk, B. (2016) · Progress in Artificial Intelligence · doi:10.1007/s13748-016-0094-0 · Cited by 2,459
SMOTE for Learning from Imbalanced Data: Progress and Challenges, Marking the 15-year Anniversary
Fernández, A., García, S., Herrera, F., & Chawla, N. V. (2018) · Journal of Artificial Intelligence Research · doi:10.1613/jair.1.11192 · Cited by 2,416
Explaining prediction models and individual predictions with feature contributions
Štrumbelj, E., & Kononenko, I. (2014) · Knowledge and Information Systems · doi:10.1007/s10115-013-0679-x · Cited by 2,286
Visualizing the effects of predictor variables in black box supervised learning models
Apley, D. W., & Zhu, J. (2020) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/rssb.12377 · Cited by 1,535
Benchmarking state-of-the-art classification algorithms for credit scoring: an update of research
Lessmann, S., Baesens, B., Seow, H.-V., & Thomas, L. C. (2015) · European Journal of Operational Research · doi:10.1016/j.ejor.2015.05.030 · Cited by 1,284
Contributions to the Theory of Games
Rubin, H., Kuhn, H. W., & Tucker, A. W. (1952) · Econometrica · doi:10.2307/1907817 · Cited by 1,206
Measuring classifier performance: a coherent alternative to the area under the ROC curve
Hand, D. (2009) · Machine-mediated learning · doi:10.1007/s10994-009-5119-5 · Cited by 1,116
An experimental comparison of classification algorithms for imbalanced credit scoring data sets
Brown, I., & Mues, C. (2011) · Expert Systems with Applications · doi:10.1016/j.eswa.2011.09.033 · Cited by 813
A boosted decision tree approach using Bayesian hyper-parameter optimization for credit scoring
Xia, Y., Liu, C., Li, Y., & Liu, N. (2017) · Expert Systems with Applications · doi:10.1016/j.eswa.2017.02.017 · Cited by 809
Explaining Rare Events in International Relations
King, G., & Zeng, L. (2001) · International Organization · doi:10.1162/00208180152507597 · Cited by 778
Explainable Machine Learning in Credit Risk Management
Bussmann, N., Giudici, P., Marinelli, D., & Papenbrock, J. (2020) · Computational Economics · doi:10.1007/s10614-020-10042-0 · Cited by 635
Machine Learning or Econometrics for Credit Scoring: Let's Get the Best of Both WorldsPreprint
Dumitrescu, E., Hué, S., Christophe Hurlin, Y., & Tokpavi, S. (2020) · SSRN Electronic Journal · doi:10.1016/j.ejor.2021.06.053 · Cited by 537
A Systematic Review on Imbalanced Data Challenges in Machine Learning
Kaur, H., Pannu, H. S., & Malhi, A. K. (2019) · ACM Computing Surveys · doi:10.1145/3343440 · Cited by 492
The Eu General Data Protection Regulation (Gdpr): A Practical Guide
Voigt, P., & Bussche, A. V. D. (2017) · Cited by 456
Comprehensible credit scoring models using rule extraction from support vector machines
Martens, D., Baesens, B., Van Gestel, T., & Vanthienen, J. (2007) · European Journal of Operational Research · doi:10.1016/j.ejor.2006.04.051 · Cited by 448
The many Shapley values for model explanationPreprint
Sundararajan, M., & Najmi, A. (2019) · RePEc: Research Papers in Economics · doi:10.48550/arxiv.1908.08474 · Cited by 415
Chang, Y.-C., Chang, K., & Wu, G.-J. (2018) · Applied Soft Computing · doi:10.1016/j.asoc.2018.09.029 · Cited by 341
On the Robustness of Interpretability Methods
Alvarez-Melis, D., & Jaakkola, T. S. (2018) · arXiv · doi:10.48550/arxiv.1806.08049 · Cited by 310
Credit Scoring and Its Applications
Thomas, L. C., Crook, J. N., & Edelman, D. B. (2017) · Cited by 308
SHAP and LIME: An Evaluation of Discriminative Power in Credit Risk
Gramegna, A., & Giudici, P. (2021) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2021.752558 · Cited by 306
A benchmark of machine learning approaches for credit score prediction
Moscato, V., Picariello, A., & Sperlí, G. (2020) · Expert Systems with Applications · doi:10.1016/j.eswa.2020.113986 · Cited by 274
Deep learning for credit scoring: Do or don’t?
Gunnarsson, B. R., Broucke, S. V., Baesens, B., Óskarsdóttir, M., & Lemahieu, W. (2021) · European Journal of Operational Research · doi:10.1016/j.ejor.2021.03.006 · Cited by 272
Transparency, auditability, and explainability of machine learning models in credit scoring
Bücker, M., Szepannek, G., Gosiewska, A., & Biecek, P. (2021) · Journal of the Operational Research Society · doi:10.1080/01605682.2021.1922098 · Cited by 254
Statistical stability indices for LIME: Obtaining reliable explanations for machine learning models
Visani, G., Bagli, E., Chesani, F., Poluzzi, A., & Capuzzo, D. (2021) · Journal of the Operational Research Society · doi:10.1080/01605682.2020.1865846 · Cited by 243
28th Conference on Uncertainty in Artificial Intelligence
Dibangoye, J., Amato, C., & Doniec, A. (2012) · HAL Portal Artxiker (Hindustan Aeronautics Limited (India)) · Cited by 236
Subagging for credit scoring models
Paleologo, G. A., Elisseeff, A., & Antonini, G. (2009) · European Journal of Operational Research · doi:10.1016/j.ejor.2009.03.008 · Cited by 215
Feature relevance quantification in explainable AI: A causal problem
Janzing, D., Minorics, L., & Blöbaum, P. (2019) · arXiv · doi:10.48550/arxiv.1910.13413 · Cited by 207
Explainability of a Machine Learning Granting Scoring Model in Peer-to-Peer Lending
Garzón, M. J. A., Arroyo, J., Caparrini, A., & Vargas, M. J. S. (2020) · IEEE Access · doi:10.1109/access.2020.2984412 · Cited by 192
Instance sampling in credit scoring: An empirical study of sample size and balancing
Crone, S. F., & Finlay, S. (2011) · International Journal of Forecasting · doi:10.1016/j.ijforecast.2011.07.006 · Cited by 190
Machine Learning Explainability in Finance: An Application to Default Risk AnalysisPreprint
Bracke, P., Datta, A., Jung, C., & Sen, S. (2019) · SSRN Electronic Journal · doi:10.2139/ssrn.3435104 · Cited by 175
Sanz, J., Bernardo, D., Herrera, F., Bustince, H., & Hagras, H. (2014) · IEEE Transactions on Fuzzy Systems · doi:10.1109/tfuzz.2014.2336263 · Cited by 173
Credit scoring based on tree-enhanced gradient boosting decision trees
Liu, W., Fan, H., & Xia, M. (2021) · Expert Systems with Applications · doi:10.1016/j.eswa.2021.116034 · Cited by 156
On the suitability of resampling techniques for the class imbalance problem in credit scoring
Marqués, A. I., García, V., & Sánchez, J. S. (2012) · Journal of the Operational Research Society · doi:10.1057/jors.2012.120 · Cited by 153
Evaluating diagnostic tests: The area under the ROC curve and the balance of errors
Hand, D. J. (2010) · Statistics in Medicine · doi:10.1002/sim.3859 · Cited by 133
Deep Learning for Mortgage RiskPreprint
Sirignano, J. A., Sadhwani, A., & Giesecke, K. (2018) · SSRN Electronic Journal · doi:10.2139/ssrn.2799443 · Cited by 125
ALIME: Autoencoder Based Approach for Local Interpretability
Shankaranarayana, S. M., & Runje, D. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-33607-3_49 · Cited by 118
Fitzpatrick, T., & Mues, C. (2015) · European Journal of Operational Research · doi:10.1016/j.ejor.2015.09.014 · Cited by 113
Reliable Post hoc Explanations: Modeling Uncertainty in ExplainabilityPreprint
Slack, D., Hilgard, S., Singh, S., & Lakkaraju, H. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2008.05030 · Cited by 95
Infinitely Imbalanced Logistic Regression
Owen, A. B. (2007) · doi:10.5555/1248659.1248686 · Cited by 94
Zhang, Z., Gao, G., & Shi, Y. (2014) · European Journal of Operational Research · doi:10.1016/j.ejor.2014.01.044 · Cited by 92
Credit risk prediction in an imbalanced social lending environment
Namvar, A., Siami, M., Rabhi, F., & Naderpour, M. (2018) · International Journal of Computational Intelligence Systems · doi:10.2991/ijcis.11.1.70 · Cited by 84
Forecasting Loan Default in Europe with Machine Learning
Barbaglia, L., Manzan, S., & Tosetti, E. (2020) · Journal of Financial Econometrics · doi:10.1093/jjfinec/nbab010 · Cited by 82
Zafar, M. R., & Khan, N. M. (2019) · arXiv · doi:10.48550/arxiv.1906.10263 · Cited by 69
Calabrese, R., Marra, G., & Osmetti, S. A. (2015) · Journal of the Operational Research Society · doi:10.1057/jors.2015.64 · Cited by 67
Self-citationDirective Explanations for Actionable Explainability in Machine Learning Applications
Singh, R., Miller, T., Lyons, H., Sonenberg, L., Velloso, E., Vetere, F., Howe, P. D. L., & Dourish, P. (2023) · ACM Transactions on Interactive Intelligent Systems · doi:10.1145/3579363 · Cited by 57
BayLIME: Bayesian Local Interpretable Model-Agnostic Explanations
Zhao, X., Huang, W., Huang, X., Robu, V., & Flynn, D. (2020) · Warwick Research Archive Portal (University of Warwick) · doi:10.48550/arxiv.2012.03058 · Cited by 56
Multilayer network analysis for improved credit risk prediction
Óskarsdóttir, M., & Bravo, C. (2021) · Omega · doi:10.1016/j.omega.2021.102520 · Cited by 55
Bueff, A., Cytryński, M., Calabrese, R., Jones, M., Roberts, J., Moore, J., & Brown, I. (2022) · Expert Systems with Applications · doi:10.1016/j.eswa.2022.117271 · Cited by 49
Self-citationEfficient Shapley Explanation for Features Importance Estimation Under Uncertainty
Li, X., Zhou, Y., Dvornek, N. C., Gu, Y., Ventola, P., & Duncan, J. S. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-59710-8_77 · Cited by 45
A comparative analysis of the UK and Italian small businesses using Generalised Extreme Value models
Andreeva, G., Calabrese, R., & Osmetti, S. (2014) · European Journal of Operational Research · doi:10.1016/j.ejor.2015.07.062 · Cited by 44
Self-citationIntelligent Data Engineering and Automated Learning – IDEAL 2019
Kuutti, S., Bowden, R., Joshi, H., de Temple, R., & Fallah, S. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-33607-3 · Cited by 43
Explainability of SMOTE Based Oversampling for Imbalanced Dataset Problems
Patil, A., Framewala, A., & Kazi, F. (2020) · International Conference on Information and Computer Technologies (ICICT) · doi:10.1109/icict50521.2020.00015 · Cited by 26
Improving Forecast of Binary Rare Events Data: A GAM‐Based Approach
Calabrese, R., & Osmetti, S. A. (2015) · Journal of Forecasting · doi:10.1002/for.2335 · Cited by 19
Self-citationIssues using logistic regression with class imbalance, with a case study from credit risk modelling
Li, Y., Bellotti, A. G., & Adams, N. M. (2019) · Foundations of Data Science · doi:10.3934/fods.2019016 · Cited by 14
Decision Trees as Interpretable Bank Credit Scoring Models
Szwabe, A., & Misiorek, P. (2018) · Communications in computer and information science · doi:10.1007/978-3-319-99987-6_16 · Cited by 12
(2018) · Communications in computer and information science · doi:10.1007/978-3-319-99987-6 · Cited by 3
Research works printed but not linked: 3
- Ekstrøm, 2019, Sequential rank agreement methods for comparison of ranked lists, Biostatistics, 20, 582, 10.1093/biostatistics/kxy017 · DOI
- Thomas, 2017, vol. 6
- Wachter, 2017, Counterfactual explanations without opening the black box: Automated decisions and the GDPR, SSRN Electronic Journal, 10.2139/ssrn.3063289 · DOI · Paper page
Cited by
Sorted by citations
Babatunde, S. O., Odejide, O. A., Edunjobi, T. E., & Ogundipe, D. O. (2024) · International Journal of Management & Entrepreneurship Research · doi:10.51594/ijmer.v6i3.964 · Cited by 288
Husain, G., Nasef, D., Jose, R., Mayer, J., Bekbolatova, M., Devine, T. J., & Toma, M. (2025) · Algorithms · doi:10.3390/a18010037 · Cited by 152
Ogundipe, D. O., Odejide, O. A., & Edunjobi, T. E. (2024) · Open Access Research Journal of Science and Technology · doi:10.53022/oarjst.2024.10.2.0045 · Cited by 106
AI IN PROJECT MANAGEMENT: EXPLORING THEORETICAL MODELS FOR DECISION-MAKING AND RISK MANAGEMENT
Odejide, O. A., & Edunjobi, T. E. (2024) · Engineering Science & Technology Journal · doi:10.51594/estj.v5i3.959 · Cited by 97
Theoretical frameworks in AI for credit risk assessment: Towards banking efficiency and accuracy
Edunjobi, T. E., & Odejide, O. A. (2024) · International Journal of Scientific Research Updates · doi:10.53430/ijsru.2024.7.1.0030 · Cited by 87
Metadata
- Authors
- Chen, Y., Calabrese, R., & Martin-Barragan, B.
- Affiliations
- University of Edinburgh (GB)
- Corresponding author
- Chen, Yujia
- Venue
- European Journal of Operational Research
- Publisher
- Elsevier BV
- Published
- 2024-01
- Volume
- 312
- Issue
- 1
- Pages
- 357-372
- ISSN
- 0377-2217 (ISSN-L)
- OpenAlex
- W4381997116
- Cited by
- 190
- References
- 71
- Citations by year
- 2026: 72 · 2025: 62 · 2024: 49
- FWCI
- 16.55
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- European Journal of Operational Research (publishedVersion, cc-by)
- RePEc: Research Papers in Economics (submittedVersion)
- Edinburgh Research Explorer (University of Edinburgh) (submittedVersion, cc-by)
- Funders
- Economic and Social Research Council (ES/W010259/1)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
- Physical Sciences › Computer Science › Artificial Intelligence › Imbalanced Data Classification Techniques
- Social Sciences › Business, Management and Accounting › Accounting › Financial Distress and Bankruptcy Prediction
- Keywords
- class imbalance, credit scoring, interpretability, lime, SHAP, explanation stability, mortgage default, residential mortgages, default prediction
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
