The DOI matches its Crossref record; 69 of the 69 references it cites were found in a registry or an index.
A Survey of Decision Trees: Concepts, Algorithms, and Applications
Open accessAbstract
Machine learning (ML) has been instrumental in solving complex problems and significantly advancing different areas of our lives. Decision tree-based methods have gained significant popularity among the diverse range of ML algorithms due to their simplicity and interpretability. This paper presents a comprehensive overview of decision trees, including the core concepts, algorithms, applications, their early development to the recent high-performing ensemble algorithms and their mathematical and algorithmic representations, which are lacking in the literature and will be beneficial to ML researchers and industry experts. Some of the algorithms include classification and regression tree (CART), Iterative Dichotomiser 3 (ID3), C4.5, C5.0, Chi-squared Automatic Interaction Detection (CHAID), conditional inference trees, and other tree-based ensemble algorithms, such as random forest, gradient-boosted decision trees, and rotation forest. Their utilisation in recent literature is also discussed, focusing on applications in medical diagnosis and fraud detection.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
1 retracted
Shamrat, F. M. J. M., Chakraborty, S., Billah, M. M., Das, P., Muna, J. N., & Ranjan, R. (2021) · International Conference on Trends in Electronics and Informatics (ICOEI) · doi:10.1109/icoei51242.2021.9452898 · Cited by 35
Retracted(1992) · Cited by 23,431
Quinlan, J. R. (1986) · Machine Learning · doi:10.1007/bf00116251 · Cited by 21,439
Breiman, L. (1996) · Machine Learning · doi:10.1007/bf00058655 · Cited by 16,325
Classification And Regression Trees
Breiman, L., Friedman, J. H., Olshen, R. A., & Stone, C. J. (2017) · doi:10.1201/9781315139470 · Cited by 11,417
Unbiased Recursive Partitioning: A Conditional Inference Framework
Hothorn, T., Hornik, K., & Zeileis, A. (2006) · Journal of Computational and Graphical Statistics · doi:10.1198/106186006x133933 · Cited by 4,021
Conditional variable importance for random forests
Strobl, C., Boulesteix, A.-L., Kneib, T., Augustin, T., & Zeileis, A. (2008) · BMC Bioinformatics · doi:10.1186/1471-2105-9-307 · Cited by 3,254
An exploratory technique for investigating large quantities of categorical data
Kass, G. V. (1980) · Applied Statistics · doi:10.2307/2986296 · Cited by 2,880
A Survey of Ensemble Learning: Concepts, Algorithms, Applications, and Prospects
Mienye, I. D., & Sun, Y. (2022) · IEEE Access · doi:10.1109/access.2022.3207287 · Cited by 1,298
Self-citationBertsimas, D., & Dunn, J. (2017) · Machine Learning · doi:10.1007/s10994-017-5633-9 · Cited by 638
Improving the accuracy of medical diagnosis with causal machine learning
Richens, J. G., Lee, C. M., & Johri, S. (2020) · Nature Communications · doi:10.1038/s41467-020-17419-7 · Cited by 598
Recent advances in decision trees: an updated survey
Costa, V. G., & Pedreira, C. E. (2023) · Artificial Intelligence Review · doi:10.1007/s10462-022-10275-5 · Cited by 572
Artificial intelligence and machine learning in finance: A bibliometric review
Ahmed, S., Alshater, M. M., Ammari, A. E., & Hammami, H. (2022) · Research in International Business and Finance · doi:10.1016/j.ribaf.2022.101646 · Cited by 464
An Experimental Study With Imbalanced Classification Approaches for Credit Card Fraud Detection
Makki, S., Assaghir, Z., Taher, Y., Haque, R., Hacid, M.-S., & Zeineddine, H. (2019) · IEEE Access · doi:10.1109/access.2019.2927266 · Cited by 338
The CART decision tree for mining data streams
Rutkowski, L., Jaworski, M., Pietruczuk, L., & Duda, P. (2014) · Information Sciences · doi:10.1016/j.ins.2013.12.060 · Cited by 327
Mahbooba, B., Timilsina, M., Sahal, R., & Serrano, M. (2021) · Complexity · doi:10.1155/2021/6634811 · Cited by 327
Towards Reverse-Engineering Black-Box Neural Networks
Oh, S. J., Schiele, B., & Fritz, M. (2019) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-28954-6_7 · Cited by 291
Nijman, S., Leeuwenberg, A., Beekers, I., Verkouter, I., Jacobs, J., Bots, M., Asselbergs, F., Moons, K., & Debray, T. (2022) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2021.11.023 · Cited by 269 · cited 1×
“Currently, decision trees either ignore instances with missing values or use surrogate splits to make predictions [86], [87].”
BackgroundAzam, Z., Islam, M. M., & Huda, M. N. (2023) · IEEE Access · doi:10.1109/access.2023.3296444 · Cited by 265
Application of decision tree-based ensemble learning in the classification of breast cancer
Ghiasi, M. M., & Zendehboudi, S. (2021) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2020.104089 · Cited by 248
Formation lithology classification using scalable gradient boosted decision trees
Dev, V. A., & Eden, M. R. (2019) · Computers & Chemical Engineering · doi:10.1016/j.compchemeng.2019.06.001 · Cited by 242
GBDT-MO: Gradient-Boosted Decision Trees for Multiple Outputs
Zhang, Z., & Jung, C. (2021) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2020.3009776 · Cited by 236
The effect of splitting on random forests
Ishwaran, H. (2015) · Machine Learning · doi:10.1007/s10994-014-5451-2 · Cited by 230
Decision Tree and Ensemble Learning Algorithms with Their Applications in Bioinformatics
Che, D., Liu, Q., Rasheed, K., & Tao, X. (2011) · Advances in Experimental Medicine and Biology · doi:10.1007/978-1-4419-7046-6_19 · Cited by 223
Seixas, F. L., Zadrozny, B., Laks, J., Conci, A., & Muchaluat Saade, D. C. (2014) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2014.04.010 · Cited by 215
Arora, N., & Kaur, P. D. (2020) · Applied Soft Computing · doi:10.1016/j.asoc.2019.105936 · Cited by 210
Data Mining Tools See5 and C5.0
Quinlan, J. R. (2004) · Medical Entomology and Zoology · Cited by 201
Bankruptcy Prediction using the XGBoost Algorithm and Variable Importance Feature Engineering
Ben Jabeur, S., Stef, N., & Carmona, P. (2023) · Computational Economics · doi:10.1007/s10614-021-10227-1 · Cited by 199
Explainable decision forest: Transforming a decision forest into an interpretable tree
Sagi, O., & Rokach, L. (2020) · Information Fusion · doi:10.1016/j.inffus.2020.03.013 · Cited by 189
Zihni, E., Madai, V. I., Livne, M., Galinovic, I., Khalil, A. A., Fiebach, J. B., & Frey, D. (2020) · PLOS ONE · doi:10.1371/journal.pone.0231166 · Cited by 187
An Investigation of Credit Card Default Prediction in the Imbalanced Datasets
Alam, T. M., Shaukat, K., Hameed, I. A., Luo, S., Sarwar, M. U., Shabbir, S., Li, J., & Khushi, M. (2020) · IEEE Access · doi:10.1109/access.2020.3033784 · Cited by 187
Performance analysis of cost-sensitive learning methods with application to imbalanced medical data
Mienye, I. D., & Sun, Y. (2021) · Informatics in Medicine Unlocked · doi:10.1016/j.imu.2021.100690 · Cited by 187
Self-citationConditional Inference Trees and Random Forests
Levshina, N. (2020) · Springer eBooks · doi:10.1007/978-3-030-46216-1_25 · Cited by 181
Jun, M. (2021) · International Journal of Geographical Information Systems · doi:10.1080/13658816.2021.1887490 · Cited by 177
Şahin, E. K., Çölkesen, İ., & Kavzoğlu, T. (2018) · Geocarto International · doi:10.1080/10106049.2018.1516248 · Cited by 168
An intelligent payment card fraud detection system
Seera, M., Lim, C. P., Kumar, A., Dhamotharan, L., & Tan, K. H. (2024) · Annals of Operations Research · doi:10.1007/s10479-021-04149-2 · Cited by 160
Credit scoring based on tree-enhanced gradient boosting decision trees
Liu, W., Fan, H., & Xia, M. (2021) · Expert Systems with Applications · doi:10.1016/j.eswa.2021.116034 · Cited by 157
García, V., Marqués, A. I., & Sánchez, J. S. (2018) · Information Fusion · doi:10.1016/j.inffus.2018.07.004 · Cited by 154
Chen, M.-M., & Chen, M. (2020) · Information · doi:10.3390/info11050270 · Cited by 151
Wang, Y., Zhang, Y., Lu, Y., & Yu, X. (2020) · Procedia Computer Science · doi:10.1016/j.procs.2020.06.069 · Cited by 141
SparseGPT: Massive Language Models Can Be Accurately Pruned in One-Shot
Frantar, E., & Alistarh, D. (2023) · arXiv · doi:10.48550/arxiv.2301.00774 · Cited by 131 · cited 1×
“It often requires a separate validation dataset to assess the impact of pruning [35].”
BackgroundEnsemble of optimal trees, random forest and random projection ensemble classification
Khan, Z., Gul, A., Perperoglou, A., Miftahuddin, M., Mahmoud, O., Adler, W., & Lausen, B. (2019) · Advances in Data Analysis and Classification · doi:10.1007/s11634-019-00364-9 · Cited by 128
Ahmad, G. N., Shafiullah, Algethami, A. A., Fatima, H., & Akhter, S. M. H. (2022) · IEEE Access · doi:10.1109/access.2022.3153047 · Cited by 120
Induction of decision trees as classification models through metaheuristics
Rivera-López, R., Canul-Reich, J., Mezura‐Montes, E., & Cruz‐Chávez, M. A. (2021) · Swarm and Evolutionary Computation · doi:10.1016/j.swevo.2021.101006 · Cited by 101
Demir, S., & Şahin, E. K. (2021) · Soil Dynamics and Earthquake Engineering · doi:10.1016/j.soildyn.2021.107130 · Cited by 96
Eliciting brand-related social media engagement: A conditional inference tree framework
Schivinski, B. (2019) · Journal of Business Research · doi:10.1016/j.jbusres.2019.08.045 · Cited by 93
Piramuthu, S. (2006) · Expert Systems with Applications · doi:10.1016/j.eswa.2006.12.030 · Cited by 90
Mustapha, S. M. F. D. S. (2023) · Applied System Innovation · doi:10.3390/asi6050086 · Cited by 70
A Review and Experimental Comparison of Multivariate Decision Trees
Cañete-Sifuentes, L., Monroy, R., & Medina‐Pérez, M. A. (2021) · IEEE Access · doi:10.1109/access.2021.3102239 · Cited by 60
A deep learning approach for Maize Lethal Necrosis and Maize Streak Virus disease detection
O’Halloran, T., Obaido, G., Otegbade, B., & Mienye, I. D. (2024) · Machine Learning with Applications · doi:10.1016/j.mlwa.2024.100556 · Cited by 55
Self-citationAnalysis of Credal-C4.5 for classification in noisy domains
Mantas, C. J., Abellán, J., & Castellano, J. G. (2016) · Expert Systems with Applications · doi:10.1016/j.eswa.2016.05.035 · Cited by 52
Xia, Y. (2019) · IEEE Access · doi:10.1109/access.2019.2927602 · Cited by 51
Application of Chi-square discretization algorithms to ensemble classification methods
Peker, N., & Kubat, C. (2021) · Expert Systems with Applications · doi:10.1016/j.eswa.2021.115540 · Cited by 47
Yao, G., Hu, X., Zhou, T., & Zhang, Y. (2022) · Expert Systems · doi:10.1111/exsy.12953 · Cited by 41
Lazebnik, T., & Bunimovich‐Mendrazitsky, S. (2023) · Data & Knowledge Engineering · doi:10.1016/j.datak.2023.102173 · Cited by 36
Two-stage rule extraction method based on tree ensemble model for interpretable loan evaluation
Dong, L.-A., Ye, X., & Yang, G. (2021) · Information Sciences · doi:10.1016/j.ins.2021.05.063 · Cited by 31
Optimal Causal Decision Trees Ensemble for Improved Prediction and Causal Inference
Younas, N., Ali, A., Hina, H., Hamraz, M., Khan, Z., & Aldahmani, S. (2022) · IEEE Access · doi:10.1109/access.2022.3146406 · Cited by 31
Analysis of Attrition Studies Within the Computer Sciences
Obaido, G., Agbo, F. J., Alvarado, C., & Oyelere, S. S. (2023) · IEEE Access · doi:10.1109/access.2023.3280075 · Cited by 30
Entropy based C4.5-SHO algorithm with information gain optimization in data mining
Reddy, G. S., & Chittineni, S. (2021) · PeerJ Computer Science · doi:10.7717/peerj-cs.424 · Cited by 29
Analysis of Machine Learning Techniques for Credit Card Fraud Detection
Nadim, A. H., Sayem, I. M., Mutsuddy, A., et al. (2019) · doi:10.1109/icmlde49015.2019.00019 · Cited by 28
Effective Feature Selection for Improved Prediction of Heart Disease
Mienye, I. D., & Sun, Y. (2022) · Lecture notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering · doi:10.1007/978-3-030-93314-2_6 · Cited by 25
Self-citationAn Ensemble of Optimal Trees for Class Membership Probability Estimation
Khan, Z., Gul, A., Mahmoud, O., Miftahuddin, M., Perperoglou, A., Adler, W., & Lausen, B. (2016) · Studies in classification, data analysis, and knowledge organization · doi:10.1007/978-3-319-25226-1_34 · Cited by 23
Measure inducing classification and regression trees for functional data
Belli, E., & Vantini, S. (2021) · Statistical Analysis and Data Mining The ASA Data Science Journal · doi:10.1002/sam.11569 · Cited by 21
An Improved Ensemble Method for Predicting Hyperchloremia in Adults With Diabetic Ketoacidosis
Obaido, G., Ogbuokiri, B., Chukwu, C. W., Osaye, F. J., Egbelowo, O. F., Uzochukwu, M. I., Mienye, I. D., Aruleba, K., Primus, M., & Achilonu, O. (2024) · IEEE Access · doi:10.1109/access.2024.3351188 · Cited by 21
Self-citationConcise rule induction algorithm based on one-sided maximum decision tree approach
Hong, J.-S., Lee, J., & Sim, M. K. (2023) · Expert Systems with Applications · doi:10.1016/j.eswa.2023.121365 · Cited by 13
Rigorous Evaluation of Computer Processors with Statistical Model Checking
Mazurek, F., Tschand, A., Wang, Y., Pajić, M., & Sorin, D. J. (2023) · IEEE/ACM International Symposium on Microarchitecture (MICRO) · doi:10.1145/3613424.3623785 · Cited by 7
Cutting down high dimensional data with Fuzzy weighted forests (FWF)
Wang, T., Gault, R., & Greer, D. (2022) · IEEE International Conference on Fuzzy Systems (FUZZ-IEEE) · doi:10.1109/fuzz-ieee55066.2022.9882660 · Cited by 6
Secure decision tree classification with decentralized authorization and access control
Wang, C., Xu, J. F., Tan, S., & Yin, L. (2023) · Computer Standards & Interfaces · doi:10.1016/j.csi.2023.103818 · Cited by 6
Performance Analysis of Algorithms for Credit Card Fraud Detection
Rawat, A., Aswal, S. S., Gupta, S., Singh, A. P., Singh, S. P., & Purohit, K. C. (2024) · International Conference on Disruptive Technologies (ICDT) · doi:10.1109/icdt61202.2024.10489771 · Cited by 2
Cited by
Recurrent Neural Networks: A Comprehensive Review of Architectures, Variants, and Applications
Mienye, I. D., Swart, T. G., & Obaido, G. (2024) · Information · doi:10.3390/info15090517 · Cited by 732
Self-citationMienye, I. D., Obaido, G., Jere, N., Mienye, E., Aruleba, K., Emmanuel, I. D., & Ogbuokiri, B. (2024) · Informatics in Medicine Unlocked · doi:10.1016/j.imu.2024.101587 · Cited by 212
Self-citationThe Use of Machine Learning Models with Optuna in Disease Prediction
Lai, L.-H., Lin, Y.-L., Liu, Y.-H., Lai, J.-P., Yang, W.-C., Hou, H.-P., & Pai, P.-F. (2024) · Electronics · doi:10.3390/electronics13234775 · Cited by 30
Metadata
- Authors
- Mienye, I. D., & Jere, N.
- Venue
- IEEE Access
- Published
- 2024
- Volume
- 12
- Pages
- 86716-86727
- ISSN
- 2169-3536 (ISSN-L)
- OpenAlex
- W4399800820
- Cited by
- 353
- References
- 69
- FWCI
- 135.09
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.