The DOI matches its Crossref record; 83 of the 83 references it cites were found in a registry or an index.
A Survey of Evolutionary Algorithms for Decision-Tree Induction
Abstract
This paper presents a survey of evolutionary algorithms that are designed for decision-tree induction. In this context, most of the paper focuses on approaches that evolve decision trees as an alternate heuristics to the traditional top-down divide-and-conquer approach. Additionally, we present some alternative methods that make use of evolutionary algorithms to improve particular components of decision-tree classifiers. The paper's original contributions are the following. First, it provides an up-to-date overview that is fully focused on evolutionary algorithms and decision trees and does not concentrate on any specific evolutionary approach. Second, it provides a taxonomy, which addresses works that evolve decision trees and works that design decision-tree components by the use of evolutionary algorithms. Finally, a number of references are provided that describe applications of evolutionary algorithms for decision-tree induction in different domains. At the end of this paper, we address some important issues and open questions that can be the subject of future research.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Genetic algorithms in search, optimization, and machine learning
(1989) · Choice Reviews Online · doi:10.5860/choice.27-0936 · Cited by 49,010
Estimating the Dimension of a Model
Schwarz, G. (1978) · The Annals of Statistics · doi:10.1214/aos/1176344136 · Cited by 47,033
Data mining: concepts and techniques
(2012) · Choice Reviews Online · doi:10.5860/choice.49-3305 · Cited by 28,531
The Elements of Statistical Learning
Hastie, T., Tibshirani, R., & Friedman, J. (2009) · Springer Series in Statistics · doi:10.1007/978-0-387-84858-7 · Cited by 25,970
UCI Machine Learning Repository
Asuncion, A. (2007) · Medical Entomology and Zoology · Cited by 25,387
Classification and Regression Trees.
Gordon, A. D., Breiman, L., Friedman, J. H., Olshen, R. A., & Stone, C. J. (1984) · Biometrics · doi:10.2307/2530946 · Cited by 23,522
(1992) · Cited by 23,431
Quinlan, J. R. (1986) · Machine Learning · doi:10.1007/bf00116251 · Cited by 21,439
Classification and Regression Trees.
Ryzin, J. V., Breiman, L., Friedman, J. H., Olshen, R. A., & Stone, C. J. (1986) · Journal of the American Statistical Association · doi:10.2307/2288003 · Cited by 20,825
Genetic Algorithms in Search, Optimization and Machine Learning
Goldberg, D. E., & Robson, D. (1988) · Cited by 18,391
Least squares quantization in PCM
Lloyd, S. (1982) · IEEE Transactions on Information Theory · doi:10.1109/tit.1982.1056489 · Cited by 15,836
No free lunch theorems for optimization
Wolpert, D. H., & Macready, W. G. (1997) · IEEE Transactions on Evolutionary Computation · doi:10.1109/4235.585893 · Cited by 14,237
Genetic Programming: On the Programming of Computers by Means of Natural Selection
Koza, J. R. (1992) · Medical Entomology and Zoology · Cited by 13,082
Witten, I. H. (2008) · Cited by 9,143
(2008) · Data Mining and Market Intelligence for Optimal Marketing Returns · doi:10.4324/9780080878096-12 · Cited by 6,954
Data mining: practical machine learning tools and techniques with Java implementations
Witten, I. H., & Frank, E. (2002) · ACM SIGMOD Record · doi:10.1145/507338.507355 · Cited by 5,137
Data Mining - Concepts and Techniques.
Perner, P. (2002) · Künstliche Intell. · Cited by 4,886
An Introduction to Data Mining
Stephens, C. R., & Sukumar, R. (2006) · The Handbook of Marketing Research · doi:10.4135/9781412973380.n22 · Cited by 4,562
A survey of decision tree classifier methodology
Safavian, S. R., & Landgrebe, D. (1991) · IEEE Transactions on Systems, Man, and Cybernetics · doi:10.1109/21.97458 · Cited by 3,808
Banzhaf, W., Francone, F. D., Keller, R. E., & Nordin, P. C. (1998) · Cited by 1,678
Evolutionary Algorithms for Solving Multi-Objective Problems (Genetic and Evolutionary Computation)
Coello, C. A. C., Lamont, G. B., & Veldhuizen, D. A. V. (2006) · Springer eBooks · Cited by 1,631
A Comprehensive Survey of Evolutionary-Based Multiobjective Optimization Techniques
Coello Coello, C. A. (1999) · Knowledge and Information Systems · doi:10.1007/bf03325101 · Cited by 1,367
Introduction to Data Mining, (First Edition)
Tan, P., Steinbach, M. S., & Kumar, V. (2005) · Addison-Wesley Longman Publishing Co., Inc. eBooks · Cited by 1,319
Automatic Construction of Decision Trees from Data: A Multi-Disciplinary Survey
Murthy, S. K. (1998) · Data Mining and Knowledge Discovery · doi:10.1023/a:1009744630224 · Cited by 991
Strongly Typed Genetic Programming
Montana, D. J. (1995) · Evolutionary Computation · doi:10.1162/evco.1995.3.2.199 · Cited by 916
Agent-Based Systems for Intelligent Manufacturing: A State-of-the-Art Survey
Shen, W., & Norrie, D. H. (1999) · Knowledge and Information Systems · doi:10.1007/bf03325096 · Cited by 808
Top-Down Induction of Decision Trees Classifiers—A Survey
Rokach, L., & Maimon, O. (2005) · IEEE Transactions on Systems, Man and Cybernetics, Part C (Applications and Reviews) · doi:10.1109/tsmcc.2004.843247 · Cited by 792
Data Mining and Knowledge Discovery with Evolutionary Algorithms
Freitas, A. A. (2002) · Natural Computing Series · doi:10.1007/978-3-662-04923-5 · Cited by 764
Self-citationComplexity measures of supervised classification problems
Ho, T. K., & Basu, M. (2002) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.990132 · Cited by 734
Chipman, H. A., George, E. I., & McCulloch, R. E. (1998) · Journal of the American Statistical Association · doi:10.1080/01621459.1998.10473750 · Cited by 734
Induction of model trees for predicting continuous classes
Wang, Y., & Witten, I. H. (1996) · Research Commons (University of Waikato) · Cited by 707
Advances in genetic programming
Fogel, D. B. (1995) · Biosystems · doi:10.1016/0303-2647(95)90007-1 · Cited by 703
A Survey on the Application of Genetic Programming to Classification
Espejo, P. G., Ventura, S., & Herrera, F. (2010) · IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews) · doi:10.1109/tsmcc.2009.2033566 · Cited by 642
A Comparison of Selection Schemes Used in Evolutionary Algorithms
Blickle, T., & Thiele, L. (1996) · Evolutionary Computation · doi:10.1162/evco.1996.4.4.361 · Cited by 590
Turney, P. D. (1995) · Journal of Artificial Intelligence Research · doi:10.1613/jair.120 · Cited by 570
Ensemble Methods in Data Mining: Improving Accuracy Through Combining Predictions
Seni, G., & Elder, J. F. (2010) · Synthesis lectures on data mining and knowledge discovery · doi:10.2200/s00240ed1v01y200912dmk002 · Cited by 492
A Distance-Based Attribute Selection Measure for Decision Tree Induction
De Mántaras, R. L. (1991) · Machine Learning · doi:10.1023/a:1022694001379 · Cited by 417
Using Model Trees for Classification
Frank, E., Wang, Y., Inglis, S., Holmes, G., & Witten, I. H. (1998) · Machine Learning · doi:10.1023/a:1007421302149 · Cited by 377
Dension, D. (1998) · Biometrika · doi:10.1093/biomet/85.2.363 · Cited by 315
Can genetic programming improve software effort estimation? A comparative evaluation
Burgess, C. J., & Lefley, M. (2001) · Information and Software Technology · doi:10.1016/s0950-5849(01)00192-6 · Cited by 300
The Use of Background Knowledge in Decision Tree Induction
Núñez, M. (1991) · Machine Learning · doi:10.1023/a:1022609710832 · Cited by 196
A critical review of multi-objective optimization in data mining: a position paper
Freitas, A. A. (2004) · ACM SIGKDD Explorations Newsletter · doi:10.1145/1046456.1046467 · Cited by 193
Self-citationInducing oblique decision trees with evolutionary algorithms
Canti-Paz, E., & Kamath, C. (2003) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2002.806857 · Cited by 169
Cost-Sensitive Learning of Classification Knowledge and Its Applications in Robotics
Tan, M. (1993) · Machine Learning · doi:10.1007/bf00993101 · Cited by 151
A multi-objective genetic programming approach to developing Pareto optimal decision trees
Zhao, H. (2006) · Decision Support Systems · doi:10.1016/j.dss.2006.12.011 · Cited by 144
OC1: randomized induction of oblique decision trees
Murthy, S. K., Kasif, S., Salzberg, S. L., & Beigel, R. (1993) · Cited by 124
GENERICITY IN EVOLUTIONARY COMPUTATION SOFTWARE TOOLS: PRINCIPLES AND CASE-STUDY
Gagné, C., & Parizeau, M. (2006) · International Journal of Artificial Intelligence Tools · doi:10.1142/s021821300600262x · Cited by 117
A Genetic Algorithm for Constructing Compact Binary Decision Trees
Cha, S.-H., & Tappert, C. C. (2009) · Journal of Pattern Recognition Research · doi:10.13176/11.44 · Cited by 116
The use of background knowledge in decision tree induction
N��ez, M. (1991) · Machine Learning · doi:10.1007/bf00114778 · Cited by 113
Generating better decision trees
Norton, S. W. (1989) · International Joint Conference on Artificial Intelligence · Cited by 109
Genetic Programming for data classification
Eggermont, J., Kok, J. N., & Kosters, W. A. (2004) · ACM Symposium on Applied Computing · doi:10.1145/967900.968104 · Cited by 107
Breeding Decision Trees Using Evolutionary Techniques
Papagelis, A., & Kalles, D. (2001) · Cited by 101
On the Importance of Comprehensible Classification Models for Protein Function Prediction
Freitas, A. A., Wieser, D., & Apweiler, R. (2009) · IEEE Transactions on Computational Biology and Bioinformatics · doi:10.1109/tcbb.2008.47 · Cited by 91
Self-citationClassification tree analysis using TARGET
Gray, J. B., & Fan, G. (2007) · Computational Statistics & Data Analysis · doi:10.1016/j.csda.2007.03.014 · Cited by 89
A Review of evolutionary Algorithms for Data Mining
Freitas, A. A. (2007) · Springer eBooks · doi:10.1007/978-0-387-69935-6_4 · Cited by 80
Self-citationMDL and Categorical Theories (Continued)
Quinlan, J. R. (1995) · Elsevier eBooks · doi:10.1016/b978-1-55860-377-6.50064-5 · Cited by 77
A genetic approach to the truck backer upper problem and the inter-twined spiral problem
Koza, J. R. (2003) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.1992.227324 · Cited by 65
Evolving decision trees using oracle guides
Johansson, U., & Niklasson, L. (2009) · IEEE Symposium on Computational Intelligence and Data Mining (CIDM) · doi:10.1109/cidm.2009.4938655 · Cited by 64
Regression Tree Analysis Using TARGET
Fan, G., & Gray, J. B. (2005) · Journal of Computational and Graphical Statistics · doi:10.1198/106186005x37210 · Cited by 58
GA Tree: genetically evolved decision trees
Papagelis, A., & Kalles, D. (2002) · IEEE International Conference on Tools with Artificial Intelligence (ICTAI) · doi:10.1109/tai.2000.889871 · Cited by 50
Evolutionary model trees for handling continuous classes in machine learning
Barros, R. C., Ruiz, D. D., & Basgalupp, M. P. (2010) · Information Sciences · doi:10.1016/j.ins.2010.11.010 · Cited by 47
Self-citationInduction of Decision Trees via Evolutionary Programming
DeLisle, R. K., & Dixon, S. L. (2004) · Journal of Chemical Information and Computer Sciences · doi:10.1021/ci034188s · Cited by 47
Towards More Optimal Medical Diagnosing with Evolutionary Algorithms
Podgorelec, V., & Kokol, P. (2001) · Journal of Medical Systems · doi:10.1023/a:1010733016906 · Cited by 41
Data mining with genetic algorithms on binary trees
Sörensen, K., & Janssens, G. K. (2003) · European Journal of Operational Research · doi:10.1016/s0377-2217(02)00824-x · Cited by 41
Using Evolutionary Algorithms to Induce Oblique Decision Trees
Cantú‐Paz, E., Kamath, C., & Kamath, R. (2000) · University of North Texas Digital Library (University of North Texas) · Cited by 39
Improving Mining of Medical Data by Outliers Prediction
Podgorelec, V., Heričko, M., & Rozman, I. (2005) · Proceedings - IEEE Symposium on Computer-Based Medical Systems · doi:10.1109/cbms.2005.68 · Cited by 37
CSL: a cost-sensitive learning system for sensing and grasping objects
Tan, M. (2002) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/robot.1990.126097 · Cited by 35
Diversification for better classification trees
Fu, Z., Golden, B., Lele, S., Raghavan, S., & Wasil, E. (2005) · Computers & Operations Research · doi:10.1016/j.cor.2005.02.035 · Cited by 35
Lexicographic multi-objective evolutionary induction of decision trees
Basgalupp, M. P., de Carvalho, A. C. P. L. F., Barros, R. C., Ruiz, D. D., & Freitas, A. A. (2009) · International Journal of Bio-Inspired Computation · doi:10.1504/ijbic.2009.022779 · Cited by 34
Self-citationLlorà, X., & Garrell, J. M. (2001) · Cited by 33
A study on efficient generation of decision trees using genetic programming
Tanigawa, T., & Zhao, Q. (2000) · Cited by 27
Structural Risk Minimization on Decision Trees Using an Evolutionary Multiobjective Optimization
Kim, D.-E. (2004) · Lecture notes in computer science · doi:10.1007/978-3-540-24650-3_32 · Cited by 27
Ma, C. Y., & Wang, X. Z. (2009) · Computers & Chemical Engineering · doi:10.1016/j.compchemeng.2009.04.005 · Cited by 27
A study on evolutionary design of binary decision trees
Zhao, Q., & Shirasaka, M. (2003) · IEEE Congress on Evolutionary Computation (CEC) · doi:10.1109/cec.1999.785518 · Cited by 26
Lossless fitness inheritance in genetic algorithms for decision trees
Kalles, D., & Papagelis, A. (2009) · Soft Computing · doi:10.1007/s00500-009-0489-y · Cited by 22
Hierarchical classification trees using type-constrained genetic programming
Tsakonas, A., & Dounias, G. D. (2003) · IEEE International Conference on Intelligent Systems · doi:10.1109/is.2002.1042573 · Cited by 20
Finding the right decision tree's induction strategy for a hard real world problem
Zorman, M., Podgorelec, V., Kokol, P., Peterson, M. G. E., Šprogar, M., & Ojsteršek, M. (2001) · International Journal of Medical Informatics · doi:10.1016/s1386-5056(01)00176-9 · Cited by 20
The Art of Building Decision Trees
Babic, S. H., Kokol, P., Podgorelec, V., Zorman, M., Šprogar, M., & Štiglic, M. M. (2000) · Journal of Medical Systems · doi:10.1023/a:1005437213215 · Cited by 18
Fitness Landscapes and Inductive Genetic Programming
Slavov, V., & Nikolaev, N. I. (1998) · Artificial Neural Nets and Genetic Algorithms · doi:10.1007/978-3-7091-6492-1_91 · Cited by 15
Evolutionary Induction of Decision Trees for Misclassification Cost Minimization
Krętowski, M., & Grześ, M. (2007) · Lecture notes in computer science · doi:10.1007/978-3-540-71618-1_1 · Cited by 15
Evolutionary Induction of Cost-Sensitive Decision Trees
Krętowski, M., & Grześ, M. (2006) · Lecture notes in computer science · doi:10.1007/11875604_15 · Cited by 13
Designing smaller decision trees using multiple objective optimization based GPs
Haruyama, S., & Zhao, Q. (2003) · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/icsmc.2002.1175597 · Cited by 11
Using genetic programming for the induction of oblique decision trees
Shali, A., Kangavari, M. R., & Bina, B. (2007) · International Conference on Machine Learning and Applications · doi:10.1109/icmla.2007.66 · Cited by 11
Cited by
Classification Based on Decision Tree Algorithm for Machine Learning
Charbuty, B., & Abdulazeez, A. (2021) · Journal of Applied Science and Technology Trends · doi:10.38094/jastt20165 · Cited by 1,871
Recent advances in decision trees: an updated survey
Costa, V. G., & Pedreira, C. E. (2023) · Artificial Intelligence Review · doi:10.1007/s10462-022-10275-5 · Cited by 572
From evolutionary computation to the evolution of things
Eiben, A. E., & Smith, J. (2015) · Nature · doi:10.1038/nature14544 · Cited by 496
Addressing the class imbalance problem in medical datasets
Rahman, M. M., & Davis, D. N. (2013) · International Journal of Machine Learning and Computing · doi:10.7763/ijmlc.2013.v3.307 · Cited by 387
A Pearson’s correlation coefficient based decision tree and its parallel implementation
Mu, Y., Liu, X., & Wang, L. (2018) · Information Sciences · doi:10.1016/j.ins.2017.12.059 · Cited by 336
Metadata
- Authors
- Barros, R. C., Basgalupp, M. P., de Carvalho, A. C. P. L. F., & Freitas, A. A.
- Venue
- IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews)
- Published
- 2012-05
- Volume
- 42
- Issue
- 3
- Pages
- 291-312
- ISSN
- 1094-6977 (ISSN-L)
- 1558-2442
- OpenAlex
- W2148423395
- Cited by
- 346
- References
- 83
- FWCI
- 17.44
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.