The DOI matches its Crossref record; 73 of the 73 references it cites were found in a registry or an index.
A new hybrid classification algorithm for customer churn prediction based on logistic regression and decision trees
Abstract
Abstract Decision trees and logistic regression are two very popular algorithms in customer churn prediction with strong predictive performance and good comprehensibility. Despite these strengths, decision trees tend to have problems to handle linear relations between variables and logistic regression has difficulties with interaction effects between variables. Therefore a new hybrid algorithm, the logit leaf model (LLM), is proposed to better classify data. The idea behind the LLM is that different models constructed on segments of the data rather than on the entire dataset lead to better predictive performance while maintaining the comprehensibility from the models constructed in the leaves. The LLM consists of two stages: a segmentation phase and a prediction phase. In the first stage customer segments are identified using decision rules and in the second stage a model is created for every leaf of this tree. This new hybrid approach is benchmarked against decision trees, logistic regression, random forests and logistic model trees with regards to the predictive performance and comprehensibility. The area under the receiver operating characteristics curve (AUC) and top decile lift (TDL) are used to measure the predictive performance for which LLM scores significantly better than its building blocks logistic regression and decision trees and performs at least as well as more advanced ensemble methods random forests and logistic model trees. Comprehensibility is addressed by a case study for which we observe some key benefits using the LLM compared to using decision trees or logistic regression.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Breiman, L. (2001) · Machine Learning · doi:10.1023/a:1010933404324 · Cited by 133,538
The meaning and use of the area under a receiver operating characteristic (ROC) curve.
Hanley, J. A., & McNeil, B. J. (1982) · Radiology · doi:10.1148/radiology.143.1.7063747 · Cited by 21,856
The WEKA data mining software: an update
Hall, M., Frank, E., Holmes, G., Pfahringer, B., Reutemann, P., & Witten, I. H. (2009) · ACM SIGKDD Explorations Newsletter · doi:10.1145/1656274.1656278 · Cited by 17,750
Friedman, J., Hastie, T., & Tibshirani, R. (2000) · The Annals of Statistics · doi:10.1214/aos/1016218223 · Cited by 6,884
Adaptive Mixtures of Local Experts
Jacobs, R. A., Jordan, M. I., Nowlan, S. J., & Hinton, G. E. (1991) · Neural Computation · doi:10.1162/neco.1991.3.1.79 · Cited by 5,384
Approximate Statistical Tests for Comparing Supervised Classification Learning Algorithms
Dietterich, T. G. (1998) · Neural Computation · doi:10.1162/089976698300017197 · Cited by 3,840
Cohen, W. W. (1995) · Machine Learning Proceedings 1995 · doi:10.1016/b978-1-55860-377-6.50023-2 · Cited by 3,787
An Introduction to Statistical Learning: with Applications in R
James, G. M., Witten, D., Hastie, T. J., & Tibshirani, R. J. (2018) · doi:10.25334/q4ht55 · Cited by 2,912
Customer Switching Behavior in Service Industries: An Exploratory Study
Keaveney, S. M. (1995) · Journal of Marketing · doi:10.2307/1252074 · Cited by 2,905
A Comparison of Alternative Tests of Significance for the Problem of $m$ Rankings
Friedman, M. (1940) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177731944 · Cited by 2,785
García, S., Fernández, A., Luengo, J., & Herrera, F. (2010) · Information Sciences · doi:10.1016/j.ins.2009.12.010 · Cited by 2,229
Sohil, F., Sohali, M. U., & Shabbir, J. (2022) · Statistical Theory and Related Fields · doi:10.1080/24754269.2021.1980261 · Cited by 1,624
Gustafsson, A., Johnson, M. D., & Roos, I. (2005) · Journal of Marketing · doi:10.1509/jmkg.2005.69.4.210 · Cited by 1,576
Verhoef, P. C. (2003) · Journal of Marketing · doi:10.1509/jmkg.67.4.30.18685 · Cited by 1,490
Data preparation for data mining
Pyle, D. (1999) · Cited by 1,368
Ganesh, J., Arnold, M. J., & Reynolds, K. E. (2000) · Journal of Marketing · doi:10.1509/jmkg.64.3.65.18028 · Cited by 1,305
Benchmarking state-of-the-art classification algorithms for credit scoring: an update of research
Lessmann, S., Baesens, B., Seow, H.-V., & Thomas, L. C. (2015) · European Journal of Operational Research · doi:10.1016/j.ejor.2015.05.030 · Cited by 1,284
Generating Accurate Rule Sets Without Global Optimization
Frank, E., & Witten, I. H. (1998) · Research Commons (University of Waikato) · doi:10.5555/645527.657305 · Cited by 1,269
Landwehr, N., Hall, M., & Frank, E. (2005) · Machine Learning · doi:10.1007/s10994-005-0466-3 · Cited by 1,214
Statistical Comparisons of Classifiers over Multiple Data Sets
DemšarJanez (2006) · Journal of Machine Learning Research · doi:10.5555/1248547.1248548 · Cited by 1,074
Fawcett, T., & Provost, F. (1997) · Data Mining and Knowledge Discovery · doi:10.1023/a:1009700419189 · Cited by 881
The Impact of Customer Relationship Characteristics on Profitable Lifetime Duration
Reinartz, W. J., & Kumar, V. (2003) · Journal of Marketing · doi:10.1509/jmkg.67.1.77.18589 · Cited by 811
Combining Pattern Classifiers: Methods and Algorithms
Kuncheva, L. I. (2014) · Wiley eBooks · doi:10.1002/9781118914564 · Cited by 673
Credit Scoring and Its Applications
Thomas, L. C., Edelman, D. B., & Crook, J. N. (2002) · Society for Industrial and Applied Mathematics eBooks · doi:10.1137/1.9780898718317 · Cited by 667
Data mining for direct marketing: problems and solutions
Ling, C. X., & Cheng-hui, L. (1998) · Cited by 661
Customer Satisfaction Cues To Support Market Segmentation and Explain Switching Behavior
Athanassopoulos, A. D. (2000) · Journal of Business Research · doi:10.1016/s0148-2963(98)00060-5 · Cited by 629
Twenty Years of Mixture of Experts
Yuksel, S. E., Wilson, J. N., & Gader, P. D. (2012) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2012.2200299 · Cited by 606
Defection detection: measuring and understanding the predictive accuracy of customer churn models
Neslin, S. A., Gupta, S., Kamakura, W., Lu, J., & Mason, C. H. (2006) · Journal of Marketing Research · doi:10.1509/jmkr.43.2.204 · Cited by 574
Handling class imbalance in customer churn prediction
Burez, J., & Van den Poel, D. (2009) · Expert Systems with Applications · doi:10.1016/j.eswa.2008.05.027 · Cited by 549
Using Neural Network Rule Extraction and Decision Tables for Credit-Risk Evaluation
Baesens, B., Setiono, R., Mues, C., & Vanthienen, J. (2003) · Management Science · doi:10.1287/mnsc.49.3.312.12739 · Cited by 536
Applying data mining to telecom churn management
Hung, S.-Y., Yen, D. C., & Wang, H.-Y. (2006) · Expert Systems with Applications · doi:10.1016/j.eswa.2005.09.080 · Cited by 514
Verbeke, W., Dejaeger, K., Martens, D., Hur, J., & Baesens, B. (2012) · European Journal of Operational Research · doi:10.1016/j.ejor.2011.09.031 · Cited by 462
Proceedings of the Fifteenth International Conference on Machine Learning
SHAVLIK, J. W. (1998) · Cited by 462
Turning telecommunications call details to churn prediction: a data mining approach
Wei, C.-P., & Chiu, I.-T. (2002) · Expert Systems with Applications · doi:10.1016/s0957-4174(02)00030-1 · Cited by 460
Comprehensible credit scoring models using rule extraction from support vector machines
Martens, D., Baesens, B., Van Gestel, T., & Vanthienen, J. (2007) · European Journal of Operational Research · doi:10.1016/j.ejor.2006.04.051 · Cited by 448
Coussement, K., & Van den Poel, D. (2008) · Expert Systems with Applications · doi:10.1016/j.eswa.2006.09.038 · Cited by 432
Self-citationBagging and Boosting Classification Trees to Predict Churn
Lemmens, A., & Croux, C. (2006) · Journal of Marketing Research · doi:10.1509/jmkr.43.2.276 · Cited by 411
Hwang, H., Jung, T., & Suh, E. (2004) · Expert Systems with Applications · doi:10.1016/s0957-4174(03)00133-7 · Cited by 411
Infinite Mixtures of Gaussian Process Experts
Rasmussen, C. E., & Ghahramani, Z. (2001) · Cited by 377
Building comprehensible customer churn prediction models with advanced rule induction techniques
Verbeke, W., Martens, D., Mues, C., & Baesens, B. (2011) · Expert Systems with Applications · doi:10.1016/j.eswa.2010.08.023 · Cited by 363
Switching between selection and fusion in combining classifiers: an experiment
Kuncheva, L. I. (2002) · IEEE Transactions on Systems, Man and Cybernetics, Part B (Cybernetics) · doi:10.1109/3477.990871 · Cited by 348
Mozer, M. C., Wolniewicz, R., Grimes, D. B., Johnson, E., & Kaushansky, H. (2000) · IEEE Transactions on Neural Networks · doi:10.1109/72.846740 · Cited by 347
Brand Choice, Purchase Incidence, and Segmentation: An Integrated Modeling Approach
Bucklin, R. E., & Gupta, S. (1992) · Journal of Marketing Research · doi:10.1177/002224379202900205 · Cited by 336
Social effects on customer retention
Nitzan, I., & Libai, B. (2011) · Journal of Marketing · doi:10.1509/jm.10.0209 · Cited by 302
Competitive One-to-One Promotions
Shaffer, G., & Zhang, Z. J. (2002) · Management Science · doi:10.1287/mnsc.48.9.1143.172 · Cited by 294
Blattberg, R. C., Kim, B.-D., & Neslin, S. A. (2008) · International Series in Quantitative Marketing · doi:10.1007/978-0-387-72579-6 · Cited by 289
Coussement, K., Lessmann, S., & Verstraeten, G. (2017) · Decision Support Systems · doi:10.1016/j.dss.2016.11.007 · Cited by 212
Self-citationCoussement, K., & Bock, K. W. D. (2013) · Journal of Business Research · doi:10.1016/j.jbusres.2012.12.008 · Cited by 198
Self-citationCustomer defection: a study of the student market in Ireland
Colgate, M., Stewart, K., & Kinsella, R. (1996) · International Journal of Bank Marketing · doi:10.1108/02652329610113144 · Cited by 194
Modeling churn using customer lifetime value
Glady, N., Baesens, B., & Croux, C. (2009) · European Journal of Operational Research · doi:10.1016/j.ejor.2008.06.027 · Cited by 187
Cost-based feature selection for Support Vector Machines: An application in credit scoring
Maldonado, S., Pérez, J., & Bravo, C. (2017) · European Journal of Operational Research · doi:10.1016/j.ejor.2017.02.037 · Cited by 171
Predicting credit card customer churn in banks using data mining
Kumar, D. A., & Ravi, V. (2008) · International Journal of Data Analysis Techniques and Strategies · doi:10.1504/ijdats.2008.020020 · Cited by 167
Johnson, M. D., Nader, G., & Fornell, C. (1996) · Journal of Economic Psychology · doi:10.1016/0167-4870(96)00002-5 · Cited by 160
Performance of classification models from a user perspective
Martens, D., Vanthienen, J., Verbeke, W., & Baesens, B. (2011) · Decision Support Systems · doi:10.1016/j.dss.2011.01.013 · Cited by 153
CHAN, C. (2007) · Expert Systems with Applications · doi:10.1016/j.eswa.2007.05.043 · Cited by 150
Chen, Z.-Y., Fan, Z., & Sun, M. (2012) · European Journal of Operational Research · doi:10.1016/j.ejor.2012.06.040 · Cited by 150
Retention sans frontieres: issues for financial service retailers
Farquhar, J. D., & Swailes, S. (1999) · International Journal of Bank Marketing · doi:10.1108/02652329910254037 · Cited by 110
Customer event history for churn prediction: How long is long enough?
Ballings, M., & den Poel, D. V. (2012) · Expert Systems with Applications · doi:10.1016/j.eswa.2012.07.006 · Cited by 108
Mixing Linear SVMs for Nonlinear Classification
Fu, Z., Robles‐Kelly, A., & Zhou, J. W. (2010) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2010.2080319 · Cited by 96
Moeyersoms, J., & Martens, D. (2015) · Decision Support Systems · doi:10.1016/j.dss.2015.02.007 · Cited by 89
A reference model for customer-centric data mining with support vector machines
Lessmann, S., & Voß, S. (2009) · European Journal of Operational Research · doi:10.1016/j.ejor.2008.12.017 · Cited by 86
Acceptance of Rules Generated by Machine Learning among Medical Experts
Mani, S., Shankle, W. R., & Pazzani, M. J. (2001) · Methods of Information in Medicine · doi:10.1055/s-0038-1634196 · Cited by 84
Bock, K. W. D., & den Poel, D. V. (2012) · Expert Systems with Applications · doi:10.1016/j.eswa.2012.01.014 · Cited by 82
Maldonado, S., Flores, Á., Verbraken, T., Baesens, B., & Weber, R. W. (2015) · Applied Soft Computing · doi:10.1016/j.asoc.2015.05.058 · Cited by 80
The moderating effects of need for cognition on drivers of customer loyalty
Hansen, H., Samuelsen, B. M., & Sallis, J. E. (2013) · European Journal of Marketing · doi:10.1108/03090561311324264 · Cited by 69
Giacinto, G., & Roli, F. (2000) · Lecture notes in computer science · doi:10.1007/3-540-45014-9_17 · Cited by 65
Identifying issues in customer relationship management at merck-medco
Torkzadeh, G., Chang, J. C.-J., & Hansen, G. W. (2006) · Decision Support Systems · doi:10.1016/j.dss.2005.10.003 · Cited by 56
Infinite Latent SVM for Classification and Multi-task Learning
Zhu, J., Chen, N., & Xing, E. P. (2018) · Figshare · doi:10.1184/r1/6475799 · Cited by 51
Cluster-Based Logistic Regression Model for Holiday Travel Mode Choice
Li, J., Weng, J., Shao, C., et al. (2016) · Procedia Engineering · doi:10.1016/j.proeng.2016.01.310 · Cited by 42
A new SOM-based method for profile generation: Theory and an application in direct marketing
Seret, A., Verbraken, T., Versailles, S., & Baesens, B. (2012) · European Journal of Operational Research · doi:10.1016/j.ejor.2012.01.044 · Cited by 32
Improving direct mail targeting through customer response modeling
Coussement, K., Harrigan, P., & Benoit, D. F. (2015) · Expert Systems with Applications · doi:10.1016/j.eswa.2015.06.054 · Cited by 25
Self-citationMonitoring and backtesting churn models
Lima, E. D. O., Mues, C., & Baesens, B. (2010) · Expert Systems with Applications · doi:10.1016/j.eswa.2010.07.091 · Cited by 23
Tang, L., Thomas, L. C., Fletcher, M., Pan, J., & Marshall, A. P. (2014) · European Journal of Operational Research · doi:10.1016/j.ejor.2014.01.004 · Cited by 23
Cited by
A survey on imbalanced learning: latest research, applications and future directions
Chen, W., Yang, K., Yu, Z., Shi, Y., & Chen, C. L. P. (2024) · Artificial Intelligence Review · doi:10.1007/s10462-024-10759-6 · Cited by 506
Dumitrescu, E., Hué, S., Hurlin, C., & Tokpavi, S. (2022) · European Journal of Operational Research · doi:10.1016/j.ejor.2021.06.053 · Cited by 430
Ullah, I., Raza, B., Malik, A. K., Imran, M., Islam, S. U., & Kim, S. W. (2019) · IEEE Access · doi:10.1109/access.2019.2914999 · Cited by 393
Sheng, J., Amankwah‐Amoah, J., Khan, Z., & Wang, X. (2021) · British Journal of Management · doi:10.1111/1467-8551.12441 · Cited by 369
Imani, M., Beikmohammadi, A., & Arabnia, H. R. (2025) · Technologies · doi:10.3390/technologies13030088 · Cited by 256
Metadata
- Authors
- De Caigny, A., Coussement, K., & De Bock, K. W.
- Venue
- European Journal of Operational Research
- Publisher
- Elsevier BV
- Published
- 2018-09
- Volume
- 269
- Issue
- 2
- Pages
- 760-772
- ISSN
- 0377-2217 (ISSN-L)
- OpenAlex
- W2792328488
- Cited by
- 524
- References
- 73
- FWCI
- 83.89
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.