The DOI matches its Crossref record; 98 of the 98 references it cites were found in a registry or an index.
Learning Classifier Systems: A Complete Introduction, Review, and Roadmap
Open accessAbstract
If complexity is your problem, learning classifier systems (LCSs) may offer a solution. These rule-based, multifaceted, machine learning algorithms originated and have evolved in the cradle of evolutionary biology and artificial intelligence. The LCS concept has inspired a multitude of implementations adapted to manage the different problem domains to which it has been applied (e.g., autonomous robotics, classification, knowledge discovery, and modeling). One field that is taking increasing notice of LCS is epidemiology, where there is a growing demand for powerful tools to facilitate etiological discovery. Unfortunately, implementation optimization is nontrivial, and a cohesive encapsulation of implementation alternatives seems to be lacking. This paper aims to provide an accessible foundation for researchers of different backgrounds interested in selecting or developing their own LCS. Included is a simple yet thorough introduction, a historical review, and a roadmap of algorithmic components, emphasizing differences in alternative LCS implementations.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Holland, J. H. (1992) · The MIT Press eBooks · doi:10.7551/mitpress/1090.001.0001 · Cited by 47,002
Neural Networks: A Comprehensive Foundation
Haykin, S. (1998) · Cited by 30,070
Reinforcement Learning: An Introduction
(2005) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2004.842673 · Cited by 24,496
Artificial intelligence: a modern approach
(1995) · Choice Reviews Online · doi:10.5860/choice.33-1577 · Cited by 21,974
Genetic Algorithms in Search, Optimization and Machine Learning
Goldberg, D. E., & Robson, D. (1988) · Cited by 18,391
Genetic Programming: On the Programming of Computers by Means of Natural Selection
Koza, J. R. (1992) · Medical Entomology and Zoology · Cited by 13,082
UCI Repository of machine learning databases
Blake, C. L. (1998) · Medical Entomology and Zoology · Cited by 10,582
Introduction to Reinforcement Learning
Sutton, R. S., & Barto, A. G. (1998) · The MIT Press eBooks · Cited by 6,855
(2007) · Handbook of Approximation Algorithms and Metaheuristics · doi:10.1201/9781420010749-33 · Cited by 6,607
Watkins, C. (1989) · OpenGrey (Institut de l'Information Scientifique et Technique) · doi:10.17863/cam.132164 · Cited by 5,297
Learning to predict by the methods of temporal differences
Sutton, R. S. (1988) · Machine Learning · doi:10.1007/bf00115009 · Cited by 5,148
Some Studies in Machine Learning Using the Game of Checkers
Samuel, A. L. (1959) · IBM Journal of Research and Development · doi:10.1147/rd.33.0210 · Cited by 4,443
WIDROW, B., & HOFF, M. E. (1960) · doi:10.21236/ad0241531 · Cited by 4,009
Steps toward Artificial Intelligence
Minsky, M. (1961) · Proceedings of the IRE · doi:10.1109/jrproc.1961.287775 · Cited by 1,675
Some studies in machine learning using the game of checkers
Samuel, A. L. (2000) · IBM Journal of Research and Development · doi:10.1147/rd.441.0206 · Cited by 1,439
Reducing bias and inefficiency in the selection algorithm
Baker, J. E. (1987) · international conference on Genetic algorithms · Cited by 1,415
Artificial Immune Systems: A New Computational Intelligence Approach
de Castro, L. N., & Timmis, J. (2002) · Medical Entomology and Zoology · Cited by 1,406
Classifier Fitness Based on Accuracy
Wilson, S. W. (1995) · Evolutionary Computation · doi:10.1162/evco.1995.3.2.149 · Cited by 1,388
Hidden Order: How Adaptation Builds Complexity
Fukuyama, F., & Holland, J. H. (1996) · Foreign Affairs · doi:10.2307/20047667 · Cited by 1,130
Classifier systems and genetic algorithms
Booker, L. B., Goldberg, D. E., & Holland, J. H. (1989) · Artificial Intelligence · doi:10.1016/0004-3702(89)90050-7 · Cited by 952
The Design of Innovation: Lessons from and for Competent Genetic Algorithms
Goldberg, D. E. (2002) · Cited by 901
Koza, J. R. (1992) · Medical Entomology and Zoology · Cited by 825
Langley, P. (1995) · Medical Entomology and Zoology · Cited by 559
Artificial Immune Systems: A New Computational Intelligence Paradigm
de Castro, L. R., & Timmis, J. (2002) · Springer eBooks · Cited by 546
A learning system based on genetic adaptive algorithms
Smith, S. F. (1980) · Medical Entomology and Zoology · Cited by 539
ZCS: A Zeroth Level Classifier System
Wilson, S. W. (1994) · Evolutionary Computation · doi:10.1162/evco.1994.2.1.1 · Cited by 505
Using genetic algorithms for concept learning
De Jong, K. A., Spears, W. M., & Gordon, D. F. (1993) · Machine Learning · doi:10.1007/bf00993042 · Cited by 445
Letter recognition using Holland-style adaptive classifiers
Frey, P. W., & Slate, D. J. (1991) · Machine Learning · doi:10.1007/bf00114162 · Cited by 409
Credit assignment in rule discovery systems based on genetic algorithms
Grefenstette, J. J. (1988) · Machine Learning · doi:10.1007/bf00113898 · Cited by 357
Bernadó-Mansilla, E., & Garrell-Guiu, J. M. (2003) · Evolutionary Computation · doi:10.1162/106365603322365289 · Cited by 357
Classifier systems and the animat problem
Wilson, S. W. (1987) · Machine Learning · doi:10.1007/bf00058679 · Cited by 285
Knowledge Growth in an Artificial Animal
Wilson, S. W. (1986) · Springer eBooks · doi:10.1007/978-1-4757-1895-9_18 · Cited by 274
A knowledge-intensive genetic algorithm for supervised learning
Janikow, C. Z. (1994) · Machine Learning · doi:10.1007/bf00993043 · Cited by 246
Toward a Theory of Generalization and Learning in XCS
Butz, M. V., Kovacs, T., Lanzi, P. L., et al. (2004) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2003.818194 · Cited by 236
The Fuzzy Classifier System: A Classifier System for Continuously Varying Variables.
Valenzuela-Rendón, M. (1991) · ICGA · Cited by 208
Classifiers that approximate functions
Wilson, S. W. (2002) · Natural Computing · doi:10.1023/a:1016535925043 · Cited by 207
Learning Concept Classification Rules using Genetic Algorithms,
Jong, K. A. D., & Spears, W. M. (1990) · doi:10.21236/ada294470 · Cited by 206
Flexible learning of problem solving heuristics through adaptive search
Smith, S. F. (1983) · International Joint Conference on Artificial Intelligence · Cited by 198
Introduction: The Challenge of Reinforcement Learning
Sutton, R. S. (1992) · Machine Learning · doi:10.1007/bf00992695 · Cited by 195
Search-Intensive Concept Induction
Giordana, A., & Neri, F. (1995) · Evolutionary Computation · doi:10.1162/evco.1995.3.4.375 · Cited by 188
Multi-Classifier Systems: Review and a roadmap for developers
Ranawana, R., & Palade, V. (2006) · International Journal of Hybrid Intelligent Systems · doi:10.3233/his-2006-3104 · Cited by 181
Harries, M. B., Sammut, C., & Horn, K. (1998) · Machine Learning · doi:10.1023/a:1007420529897 · Cited by 178
Intelligent behavior as an adaptation to the task environment
Booker, L. B. (1982) · Deep Blue (University of Michigan) · Cited by 177
Wilson, S. W. (2001) · Lecture Notes in Computer Science · doi:10.1007/3-540-44640-0_11 · Cited by 173
Competition-Based Induction of Decision Models from Examples
Greene, D. P., & Smith, S. F. (1993) · Machine Learning · doi:10.1007/bf00993044 · Cited by 163
Reinforcement Learning: A Tutorial.
Harmon, M. E., & Harmon, S. S. (1997) · doi:10.21236/ada323194 · Cited by 159
What Is a Learning Classifier System?
Holland, J. H., Booker, L. B., Colombetti, M., Dorigo, M., Goldberg, D. E., Forrest, S., Riolo, R., Smith, R. E., Lanzi, P. L., Stolzmann, W., et al. (2000) · Lecture notes in computer science · doi:10.1007/3-540-45027-0_1 · Cited by 149
Properties of the Bucket Brigade
Holland, J. H. (1985) · international conference on Genetic algorithms · Cited by 127
Implicit Niching in a Learning Classifier System: Nature's Way
Horn, J., Goldberg, D. E., & Deb, K. (1994) · Evolutionary Computation · doi:10.1162/evco.1994.2.1.37 · Cited by 127
Holland, J. H. (1986) · Machine Learning · Cited by 121
Butz, M. V., Lanzi, P. L., & Wilson, S. W. (2008) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2007.903551 · Cited by 120
Learning classifier systems: a survey
Sigaud, O., & Wilson, S. W. (2007) · Soft Computing · doi:10.1007/s00500-007-0164-0 · Cited by 118
Genetic algorithms and classifier systems: Foundations and future directions
Holland, J. H. (1987) · OSTI OAI (U.S. Department of Energy Office of Scientific and Technical Information) · Cited by 117
Adding Temporary Memory to ZCS
Cliff, D., & Ross, S. (1994) · Adaptive Behavior · doi:10.1177/105971239400300201 · Cited by 115
Evolutionary Learning of Fuzzy Rules: Competition and Cooperation
Bonarini, A. (1996) · International series in intelligent technologies · doi:10.1007/978-1-4613-1365-6_12 · Cited by 111
Peñarroya, J. B. (2004) · Dialnet (Universidad de la Rioja) · Cited by 109
Online Learning versus Offline Learning
Ben-David, S., Kushilevitz, E., & Mansour, Y. (1997) · Machine Learning · doi:10.1023/a:1007465907571 · Cited by 98
Toward Optimal Classifier System Performance in Non-Markov Environments
Lanzi, P. L., & Wilson, S. W. (2000) · Evolutionary Computation · doi:10.1162/106365600568239 · Cited by 96
Butz, M. V., Goldberg, D. E., & Lanzi, P. L. (2005) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2005.850265 · Cited by 96
Learning classifier systems: then and now
Lanzi, P. L. (2008) · Evolutionary Intelligence · doi:10.1007/s12065-007-0003-3 · Cited by 95
A Mathematical Framework for Studying Learning in Classifier Systems
Holland, J. H. (1986) · Physica D Nonlinear Phenomena · doi:10.1016/0167-2789(86)90301-4 · Cited by 94
Improving the Performance of Genetic Algorithms in Classifier Systems
Booker, L. B. (1985) · international conference on Genetic algorithms · Cited by 89
Lookahead Planning and Latent Learning in a Classifier System
Riolo, R. (1991) · The MIT Press eBooks · doi:10.7551/mitpress/3115.003.0043 · Cited by 87
An Introduction to Anticipatory Classifier Systems
Stolzmann, W. (2000) · Lecture notes in computer science · doi:10.1007/3-540-45027-0_9 · Cited by 86
Classifier Systems that Learn Internal World Models
Booker, L. B. (1988) · Machine Learning · doi:10.1007/bf00113896 · Cited by 84
A Comparison of Q-Learning and Classifier Systems
Dorigo, M., & Bersini, H. (1994) · The MIT Press eBooks · doi:10.7551/mitpress/3117.003.0042 · Cited by 83
Learning classifier systems from a reinforcement learning perspective
Lanzi, P. L. (2002) · Soft Computing · doi:10.1007/s005000100113 · Cited by 83
An Introduction to Learning Fuzzy Classifier Systems
Bonarini, A. (2000) · Lecture notes in computer science · doi:10.1007/3-540-45027-0_4 · Cited by 75
ALECSYS and the AutonoMouse: Learning to Control a Real Robot by Distributed Classifier Systems
Dorigo, M. (1995) · Machine Learning · doi:10.1023/a:1022649410928 · Cited by 71
Multiagent coordination with learning classifier systems
Sen, S., & Sekaran, M. (1996) · Lecture notes in computer science · doi:10.1007/3-540-60923-7_30 · Cited by 68
Lanzi, P. L. (2002) · IEEE Congress on Evolutionary Computation (CEC) · doi:10.1109/icec.1998.700098 · Cited by 59
Automated Global Structure Extraction for Effective Local Building Block Processing in XCS
Butz, M. V., Pelikán, M., Llorà, X., & Goldberg, D. E. (2006) · Evolutionary Computation · doi:10.1162/evco.2006.14.3.345 · Cited by 58
Anticipations Control Behavior: Animal Behavior in an Anticipatory Learning Classifier System
Butz, M. V., & Hoffmann, J. (2002) · Adaptive Behavior · doi:10.1177/1059712302010002001 · Cited by 55
Automated alphabet reduction method with evolutionary algorithms for protein structure prediction
Bacardit, J., Stout, M., Hirst, J. D., Sastry, K., Llorà, X., & Krasnogor, N. (2007) · Genetic and Evolutionary Computation Conference (GECCO) · doi:10.1145/1276958.1277033 · Cited by 55
Learning Classifier System Ensembles With Rule-Sharing
Bull, L., Studley, M., Bagnall, A. J., & Whittley, I. M. (2007) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2006.885163 · Cited by 55
A Roadmap to the Last Decade of Learning Classifier System Research
Lanzi, P. L., & Riolo, R. (2000) · Virtual Community of Pathological Anatomy (University of Castilla La Mancha) · Cited by 50
Prediction update algorithms for XCSF
Lanzi, P. L., Loiacono, D., Wilson, S. W., & Goldberg, D. E. (2006) · Genetic and Evolutionary Computation Conference (GECCO) · doi:10.1145/1143997.1144243 · Cited by 47
Analyzing the evolutionary pressures in XCS
Butz, M. V., & Pelikán, M. (2001) · Cited by 46
Bounding XCS's parameters for unbalanced datasets
Orriols-Puig, A., & Bernadó-Mansilla, E. (2006) · Genetic and Evolutionary Computation Conference (GECCO) · doi:10.1145/1143997.1144250 · Cited by 43
Context-dependent predictions and cognitive arm control with XCSF
Butz, M. V., & Herbort, O. (2008) · Genetic and Evolutionary Computation Conference (GECCO) · doi:10.1145/1389095.1389360 · Cited by 41
INCREMENTAL LEARNING OF CONTROL STRATEGIES WITH GENETIC ALGORITHMS
Grefenstette, J. J. (1989) · Elsevier eBooks · doi:10.1016/b978-1-55860-036-2.50087-4 · Cited by 39
Prediction of topological contacts in proteins using learning classifier systems
Stout, M., Bacardit, J., Hirst, J. D., Smith, R. E., & Krasnogor, N. (2008) · Soft Computing · doi:10.1007/s00500-008-0318-8 · Cited by 38
Hyper-ellipsoidal conditions in XCS
Butz, M. V., Lanzi, P. L., & Wilson, S. W. (2006) · Genetic and Evolutionary Computation Conference (GECCO) · doi:10.1145/1143997.1144237 · Cited by 36
The emergence of coupled sequences of classifiers
Riolo, R. (1989) · international conference on Genetic algorithms · Cited by 34
Butz, M. V., Goldberg, D. E., & Stolzmann, W. (2000) · Cited by 33
Mining breast cancer data with XCS
Kharbat, F. F., Bull, L., & Odeh, M. (2007) · Genetic and Evolutionary Computation Conference (GECCO) · doi:10.1145/1276958.1277362 · Cited by 33
TCS Learning Classifier System Controller on a Real Robot
Hurst, J., Bull, L., & Melhuish, C. (2002) · Lecture notes in computer science · doi:10.1007/3-540-45712-7_57 · Cited by 32
Evolving Behaviors for Cooperating Agents
Bassett, J. K., & Jong, K. A. D. (2000) · Lecture notes in computer science · doi:10.1007/3-540-39963-1_17 · Cited by 31
Bounding the Effect of Noise in Multiobjective Learning Classifier Systems
Llorà, X., & Goldberg, D. E. (2003) · Evolutionary Computation · doi:10.1162/106365603322365306 · Cited by 30
Empirical Evaluation of Ensemble Techniques for a Pittsburgh Learning Classifier System
Bacardit, J., & Krasnogor, N. (2008) · Lecture notes in computer science · doi:10.1007/978-3-540-88138-4_15 · Cited by 30
Llorà, X., Reddy, R. K., Matesic, B., & Bhargava, R. (2007) · Genetic and Evolutionary Computation Conference (GECCO) · doi:10.1145/1276958.1277366 · Cited by 27
A first order logic classifier system
Mellor, D. (2005) · Genetic and Evolutionary Computation Conference (GECCO) · doi:10.1145/1068009.1068318 · Cited by 22
Learning classifier systems in multi-agent environments
Serendynski, F. (1995) · International Conference on Genetic Algorithms in Engineering Systems: Innovations and Applications (GALESIA) · doi:10.1049/cp:19951064 · Cited by 22
Extracted global structure makes local building block processing effective in XCS
Butz, M. V., Pelikán, M., Llorà, X., & Goldberg, D. E. (2005) · Genetic and Evolutionary Computation Conference (GECCO) · doi:10.1145/1068009.1068121 · Cited by 20
A Learning Classifier Systems Bibliography
Kovacs, T., & Lanzi, P. L. (2000) · Lecture notes in computer science · doi:10.1007/3-540-45027-0_17 · Cited by 16
Grammar-Based Classifier System for Recognition of Promoter Regions
Unold, O. (2007) · Lecture notes in computer science · doi:10.1007/978-3-540-71618-1_89 · Cited by 11
Further Comparison between ATNoSFERES and XCSM
Landau, S., Picault, S., Sigaud, O., & Gérard, P. (2003) · Lecture notes in computer science · doi:10.1007/978-3-540-40029-5_7 · Cited by 6
Cielecki, Ł., & Unold, O. (2007) · Lecture notes in computer science · doi:10.1007/978-3-540-73053-8_49 · Cited by 5
Cited by
Levis, M., Leonard Westgate, C., Gui, J., Watts, B. V., & Shiner, B. (2021) · Psychological Medicine · doi:10.1017/s0033291720000173 · Cited by 87
Rule-Based Reinforcement Learning for Efficient Robot Navigation With Space Reduction
Zhu, Y., Wang, Z., Chen, C., & Dong, D. (2022) · IEEE/ASME Transactions on Mechatronics · doi:10.1109/tmech.2021.3072675 · Cited by 57
Metadata
- Authors
- Urbanowicz, R. J., & Moore, J. H.
- Venue
- Journal of Artificial Evolution and Applications
- Publisher
- Hindawi Limited
- Published
- 2009-09-22
- Volume
- 2009
- Pages
- 1-25
- ISSN
- 1687-6229 (ISSN-L)
- 1687-6237
- OpenAlex
- W2009718765
- Cited by
- 306
- References
- 98
- FWCI
- 15.90
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.