The DOI matches its Crossref record; 41 of the 41 references it cites were found in a registry or an index.
Evolutionary Algorithms for Reinforcement Learning
Open accessAbstract
There are two distinct approaches to solving reinforcement learning problems, namely, searching in value function space and searching in policy space. Temporal difference methods and evolutionary algorithms are well-known examples of these approaches. Kaelbling, Littman and Moore recently provided an informative survey of temporal difference methods. This article focuses on the application of evolutionary algorithms to the reinforcement learning problem, emphasizing alternative policy representations, credit assignment methods, and problem-specific genetic operators. Strengths and weaknesses of the evolutionary approach to reinforcement learning are presented, along with a survey of representative applications.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Genetic algorithms in search, optimization, and machine learning
(1989) · Choice Reviews Online · doi:10.5860/choice.27-0936 · Cited by 49,010
Holland, J. H. (1992) · The MIT Press eBooks · doi:10.7551/mitpress/1090.001.0001 · Cited by 47,002
Reinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. G. (1998) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.1998.712192 · Cited by 27,225
Reinforcement Learning: An Introduction
(2005) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2004.842673 · Cited by 24,496
Genetic Programming: On the Programming of Computers by Means of Natural Selection
Koza, J. R. (1992) · Medical Entomology and Zoology · Cited by 13,082
Reinforcement Learning: A Survey
Kaelbling, L. P., Littman, M. L., & Moore, A. W. (1996) · Journal of Artificial Intelligence Research · doi:10.1613/jair.301 · Cited by 8,972
Introduction to Reinforcement Learning
Sutton, R. S., & Barto, A. G. (1998) · The MIT Press eBooks · Cited by 6,855
Watkins, C. (1989) · OpenGrey (Institut de l'Information Scientifique et Technique) · doi:10.17863/cam.132164 · Cited by 5,297
Learning to predict by the methods of temporal differences
Sutton, R. S. (1988) · Machine Learning · doi:10.1007/bf00115009 · Cited by 5,148
Optimization of Control Parameters for Genetic Algorithms
Grefenstette, J. (1986) · IEEE Transactions on Systems, Man, and Cybernetics · doi:10.1109/tsmc.1986.289288 · Cited by 2,854
Self-citationArtificial Intelligence through Simulated Evolution
Fogel, L. J., Owens, A. J., & Walsh, M. J. (1966) · International Linear Collider · Cited by 2,796
Genetic algorithms with sharing for multimodal function optimization
Goldberg, D. E., & Richardson, J. T. (1987) · international conference on Genetic algorithms · Cited by 1,912
Sutton, R. S. (1990) · Machine Learning Proceedings 1990 · doi:10.1016/b978-1-55860-141-3.50030-4 · Cited by 1,314
Whitley, L. D. (1989) · international conference on Genetic algorithms · Cited by 992
Schaffer, J. D., Caruana, R. A., Eshelman, L. J., & Das, R. (1989) · international conference on Genetic algorithms · Cited by 896
Learning to control an inverted pendulum using neural networks
Anderson, C. W. (1989) · IEEE Control Systems Magazine · doi:10.1109/37.24809 · Cited by 540
Holland, J. H., & Reitman, J. S. (1978) · Pattern-Directed Inference Systems · doi:10.1016/b978-0-12-737550-2.50020-8 · Cited by 539
ZCS: A Zeroth Level Classifier System
Wilson, S. W. (1994) · Evolutionary Computation · doi:10.1162/evco.1994.2.1.1 · Cited by 505
Cognitive systems based on adaptive algorithms
Holland, J. H., & Reitman, J. S. (1977) · ACM SIGART Bulletin · doi:10.1145/1045343.1045373 · Cited by 469
Explorations in Evolutionary Robotics
Cliff, D., Husbands, P., & Harvey, I. (1993) · Adaptive Behavior · doi:10.1177/105971239300200104 · Cited by 415
Reinforcement learning with selective perception and hidden state
McCallum, A. K., & Ballard, D. H. (1996) · Cited by 411
The design and analysis of a computational model of cooperative coevolution
Potter, M. A. (1997) · Cited by 363
Learning and Sequential Decision Making
Barto, A. G., Sutton, R. S., & Watkins, C. (1989) · Cited by 357
Credit assignment in rule discovery systems based on genetic algorithms
Grefenstette, J. J. (1988) · Machine Learning · doi:10.1007/bf00113898 · Cited by 357
Self-citationEfficient reinforcement learning through symbiotic evolution
Moriarty, D. E., & Miikkulainen, R. (1996) · Machine Learning · doi:10.1007/bf00114722 · Cited by 325
Self-citationReinforcement learning with perceptual aliasing: the perceptual distinctions approach
Chrisman, L. (1992) · Cited by 313
Forming Neural Networks Through Efficient and Adaptive Coevolution
Moriarty, D. E., & Miikkulainen, R. (1997) · Evolutionary Computation · doi:10.1162/evco.1997.5.4.373 · Cited by 304
Self-citationLearning sequential decision rules using simulation models and competition
Grefenstette, J. J., Ramsey, C. L., & Schultz, A. C. (1990) · Machine Learning · doi:10.1007/bf00116876 · Cited by 271
Self-citationSelection in Massively Parallel Genetic Algorithms.
Collins, R. J., & Jefferson, D. R. (1991) · Cited by 232
Genetic Reinforcement Learning for Neurocontrol Problems
Whitley, D., Dominic, S., Das, R., & Anderson, C. W. (1993) · Machine Learning · doi:10.1007/bf00993045 · Cited by 215
Flexible learning of problem solving heuristics through adaptive search
Smith, S. F. (1983) · International Joint Conference on Artificial Intelligence · Cited by 198
A Coevolutionary Approach to Learning Sequential Decision Rules
Potter, M. A., Jong, K. A. D., & Grefenstette, J. J. (1995) · Cited by 144
Self-citationSequential Behavior and Learning in Evolved Dynamical Neural Networks
Yamauchi, B. M., & Beer, R. D. (1994) · Adaptive Behavior · doi:10.1177/105971239400200301 · Cited by 137
Exploration Bonuses and Dual Control
Dayan, P., & B, T. J. S. A. (1996) · Machine Learning · doi:10.1023/a:1018357105171 · Cited by 120
Genetic algorithms and classifier systems: Foundations and future directions
Holland, J. H. (1987) · OSTI OAI (U.S. Department of Energy Office of Scientific and Technical Information) · Cited by 117
Memory Approaches to Reinforcement Learning in Non-Markovian Domains
Lin, L., & Mitchell, T. M. (1992) · Cited by 100
Circle in the round: State space attractors for evolved sighted robots
Husbands, P., Harvey, I. R., & Cliff, D. (1995) · Robotics and Autonomous Systems · doi:10.1016/0921-8890(95)00016-9 · Cited by 70
Simple Genetic Algorithms with Linear Fitness
Vose, M. D., & Wright, A. H. (1994) · Evolutionary Computation · doi:10.1162/evco.1994.2.4.347 · Cited by 58
Evolving Obstacle Avoidance Behavior in a Robot Arm
Moriarty, D. E., & Miikkulainen, R. P. (1996) · The MIT Press eBooks · doi:10.7551/mitpress/3118.003.0056 · Cited by 40
Self-citationLEARNING ROBOT BEHAVIORS USING GENETIC ALGORITHMS
Schultz, A. C. (1994) · Cited by 17
Self-citationValiant, L. G. (2026) · Foundations of Computation and Machine Learning · doi:10.1145/3749740.3749746
Cited by
The responsibility gap: Ascribing responsibility for the actions of learning automata
Matthias, A. (2004) · Ethics and Information Technology · doi:10.1007/s10676-004-3422-1 · Cited by 1,101
A Survey on Machine-Learning Techniques in Cognitive Radios
Bkassiny, M., Li, Y., & Jayaweera, S. K. (2013) · IEEE Communications Surveys & Tutorials · doi:10.1109/surv.2012.100412.00017 · Cited by 580
Noisy Networks for Exploration
Fortunato, M., Azar, M. G., Piot, B., Menick, J., Osband, I., Graves, A., Mnih, V., Munos, R., Hassabis, D., Pietquin, O., et al. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1706.10295 · Cited by 543
A review on reinforcement learning algorithms and applications in supply chain management
Rolf, B., Jackson, I., Müller, M., Lang, S., Reggelin, T., & Ivanov, D. (2023) · International Journal of Production Research · doi:10.1080/00207543.2022.2140221 · Cited by 355
Giuliani, M., Castelletti, A., Pianosi, F., Mason, E., & Reed, P. M. (2016) · Journal of Water Resources Planning and Management · doi:10.1061/(asce)wr.1943-5452.0000570 · Cited by 257
Metadata
- Authors
- Moriarty, D. E., Schultz, A. C., & Grefenstette, J. J.
- Venue
- Journal of Artificial Intelligence Research
- Publisher
- AI Access Foundation
- Published
- 1999-09-01
- Volume
- 11
- Pages
- 241-276
- ISSN
- 1076-9757 (ISSN-L)
- OpenAlex
- W1914583973
- Cited by
- 340
- References
- 41
- FWCI
- 10.58
- Type
- journal article
- Language
- en
- Open access
- diamond
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.