The DOI matches its Crossref record; 40 of the 41 references it cites were found in a registry or an index.
Completely Derandomized Self-Adaptation in Evolution Strategies
Abstract
This paper puts forward two useful methods for self-adaptation of the mutation distribution - the concepts of derandomization and cumulation. Principle shortcomings of the concept of mutative strategy parameter control and two levels of derandomization are reviewed. Basic demands on the self-adaptation of arbitrary (normal) mutation distributions are developed. Applying arbitrary, normal mutation distributions is equivalent to applying a general, linear problem encoding. The underlying objective of mutative strategy parameter control is roughly to favor previously selected mutation steps in the future. If this objective is pursued rigorously, a completely derandomized self-adaptation scheme results, which adapts arbitrary normal mutation distributions. This scheme, called covariance matrix adaptation (CMA), meets the previously stated demands. It can still be considerably improved by cumulation - utilizing an evolution path rather than single search steps. Simulations on various test functions reveal local and global search properties of the evolution strategy with and without covariance matrix adaptation. Their performances are comparable only on perfectly scaled functions. On badly scaled, non-separable functions usually a speed up factor of several orders of magnitude is observed. On moderately mis-scaled functions a speed up factor of three to ten can be expected.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Due to its well-known robustness to local minima, the CMAES benchmark method”
From A Fully Differentiable Framework for 2D/3D Registration and the Projective Spatial Transformers (2024) · cites this paper as [40]
Citations
Cites
Numerical recipes in Pascal: the art of scientific computing
(1990) · Choice Reviews Online · doi:10.5860/choice.27-5158 · Cited by 12,040
Evolutionsstrategie : Optimierung technischer Systeme nach Prinzipien der biologischen Evolution
Rechenberg, I. (1973) · Frommann-Holzboog eBooks · Cited by 2,440
Schwefel, H. (1995) · Cited by 2,203
An Overview of Evolutionary Algorithms for Parameter Optimization
Bäck, T., & Schwefel, H. (1993) · Evolutionary Computation · doi:10.1162/evco.1993.1.1.1 · Cited by 2,111
Numerical optimization of computer models
(1982) · Mathematics and Computers in Simulation · doi:10.1016/0378-4754(82)90117-3 · Cited by 1,626
Evolutionary computation: Comments on the history and current state
Back, T., Hammel, U., & Schwefel, H.-P. (1997) · IEEE Transactions on Evolutionary Computation · doi:10.1109/4235.585888 · Cited by 1,536 · cited 1×
“It is generally recognized that the typical values for μ = 15 and λ = 100 are not sufficient for this adaptation mechanism (Bäck et al., 1997).”
BackgroundHansen, N., & Ostermeier, A. (2002) · IEEE Congress on Evolutionary Computation (CEC) · doi:10.1109/icec.1996.542381 · Cited by 1,110
Self-citation(2000) · Institute of Physics eBooks · doi:10.1887/0750306645 · Cited by 765
A framework for evolutionary optimization with approximate fitness functions
Jin, Y., Olhofer, M., & Sendhoff, B. (2002) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2002.800884 · Cited by 663
Evolution and Optimum Seeking: The Sixth Generation
Schwefel, H. (1993) · John Wiley & Sons, Inc. eBooks · Cited by 652
A Computationally Efficient Evolutionary Algorithm for Real-Parameter Optimization
Deb, K., Anand, A., & Joshi, D. (2002) · Evolutionary Computation · doi:10.1162/106365602760972767 · Cited by 617
(2000) · Institute of Physics eBooks · doi:10.1887/0750306653 · Cited by 617
Evaluating evolutionary algorithms
Whitley, D., Rana, S., Dzubera, J., & Mathias, K. E. (1996) · Artificial Intelligence · doi:10.1016/0004-3702(95)00124-7 · Cited by 406
Toward a Theory of Evolution Strategies: Self-Adaptation
Beyer, H.-G. (1995) · Evolutionary Computation · doi:10.1162/evco.1995.3.3.311 · Cited by 200
Step-size adaptation based on non-local use of selection information
Ostermeier, A., Gawelczyk, A., & Hansen, N. (1994) · Lecture notes in computer science · doi:10.1007/3-540-58484-6_263 · Cited by 198
Self-citationA Derandomized Approach to Self-Adaptation of Evolution Strategies
Ostermeier, A., Gawelczyk, A., & Hansen, N. (1994) · Evolutionary Computation · doi:10.1162/evco.1994.2.4.369 · Cited by 198
Self-citationHansen, N., Ostermeier, A., & Gawelczyk, A. (1995) · Cited by 168
Self-citationToward a Theory of Evolution Strategies: On the Benefits of Sex— the (μ/μ, λ) Theory
Beyer, H.-G. (1995) · Evolutionary Computation · doi:10.1162/evco.1995.3.1.81 · Cited by 158
Multiobjective evolutionary algorithm for the optimization of noisy combustion processes
Büche, D., Stoll, P., Dornberger, R., & Koumoutsakos, P. (2002) · IEEE Transactions on Systems Man and Cybernetics Part C (Applications and Reviews) · doi:10.1109/tsmcb.2002.804372 · Cited by 144
How to analyse evolutionary algorithms
Beyer, H.-G., Schwefel, H., & Wegener, I. (2002) · Theoretical Computer Science · doi:10.1016/s0304-3975(02)00137-8 · Cited by 130
Image processing and behavior planning for intelligent vehicles
Bucher, T., Curio, C., Edelbrunner, J., Igel, C., Kastrup, D., Leefken, I. M., Lorenz, G., Steinhage, A., & von Seelen, W. (2003) · IEEE Transactions on Industrial Electronics · doi:10.1109/tie.2002.807650 · Cited by 114
Drag Reduction and Shape Optimization of Airship Bodies
Lutz, T., & Wagner, S. (1998) · Journal of Aircraft · doi:10.2514/2.2313 · Cited by 96
On Correlated Mutations in Evolution Strategies.
Rudolph, G. (1992) · Cited by 63
Invariance, Self-Adaptation and Correlated Mutations in Evolution Strategies
Hansen, N. (2000) · Lecture notes in computer science · doi:10.1007/3-540-45356-3_35 · Cited by 61
Self-citationQualms Regarding the Optimality of Cumulative Path Length Control in CSA/CMA-Evolution Strategies
Beyer, H.-G., & Arnold, D. V. (2003) · Evolutionary Computation · doi:10.1162/106365603321828989 · Cited by 41
Francone, F. D., & Deschaine, L. M. (2003) · Information Sciences · doi:10.1016/j.ins.2003.05.006 · Cited by 41
Optimisation of a Stator Blade Used in a Transonic Compressor Cascade with Evolution Strategies
Olhofer, M., Sendhoff, B., Arima, T., & Sonoda, T. (2000) · Springer eBooks · doi:10.1007/978-1-4471-0519-0_4 · Cited by 36
Optimization of dynamic neural fields
Igel, C., Erlhagen, W., & Jancke, D. (2001) · Neurocomputing · doi:10.1016/s0925-2312(00)00328-3 · Cited by 32
Combined evolution strategies for dynamic calibration of video-based measurement systems
Cerveri, P., Pedotti, A., & Borghese, N. A. (2001) · IEEE Transactions on Evolutionary Computation · doi:10.1109/4235.930315 · Cited by 22
Registration of bone surfaces, extracted from CT-datasets, with 3D ultrasound
Winter, S., Brendel, B., Rick, A., Stockheim, M., Schmieder, K., & Ermert, H. (2002) · Biomedizinische Technik/Biomedical Engineering · doi:10.1515/bmte.2002.47.s1a.57 · Cited by 18
A preliminary investigation into directed mutations in evolutionary algorithms
Ghozeil, A., & Fogel, D. B. (1996) · Lecture notes in computer science · doi:10.1007/3-540-61723-x_997 · Cited by 18
Beyer, H.-G. (1998) · Parallel Problem Solving from Nature · Cited by 16
The number of offspring as strategy parameter in hierarchically organized evolution strategies
Herdy, M. (1993) · ACM SIGBIO Newsletter · doi:10.1145/163428.163431 · Cited by 15
An Evolution Strategy with Momentum Adaptation of the Random Number Distribution.
Ostermeier, A. (1992) · Parallel Problem Solving from Nature · Cited by 14
Self-citationOn the Desired Behaviors of Self-Adaptive Evolutionary Algorithms
Beyer, H.-G., & Deb, K. (2000) · Lecture notes in computer science · doi:10.1007/3-540-45356-3_6 · Cited by 13
On the asymptotic behavior of multirecombinant Evolution Strategies
Beyer, H.-G. (1996) · Lecture notes in computer science · doi:10.1007/3-540-61723-x_976 · Cited by 13
Ostermeier, A., & Hansen, N. (1999) · Cited by 10
Self-citationDirected mutation-a new self-adaptation for evolution strategies
Hildebrand, L., Reusch, B., & Fathi, M. (2003) · IEEE Congress on Evolutionary Computation (CEC) · doi:10.1109/cec.1999.782668 · Cited by 9
Evolving field models for inhibition effects in early vision
Igel, C., von Seelen, W., Erlhagen, W., & Jancke, D. (2002) · Neurocomputing · doi:10.1016/s0925-2312(02)00402-2 · Cited by 5
Parameter optimization for visual obstacle detection using a derandomized evolution strategy
Bergener, T., Bruckhoff, C., & Igel, C. (2001) · Cited by 5
Research works printed but not linked: 2
- Cerveri P., 2001, IEEE Transactions on Evolutionary Computation, in press.
- Olhofer M., 2000, Parmee, I., editor, Adaptive Computing in Design and Manufacture (ACDM), pages, 45
Cited by
Sorted by citations
Deep learning in neural networks: an overview
Schmidhuber, J. (2015) · Neural Networks · doi:10.1016/j.neunet.2014.09.003 · Cited by 18,570
Larian Studios Dev Team (2024) · doi:10.1145/3292500.3330701 · Cited by 8,618
“This way, the framework can identify the underlying concurrence relations after some number of independent samplings, and use the inferred concurrence relation to conduct user-selected relational sampling algorithms like CMA-ES [17] and GP-BO [18].”
MethodTaking the Human Out of the Loop: A Review of Bayesian Optimization
Shahriari, B., Swersky, K., Wang, Z., Adams, R. P., & de Freitas, N. (2015) · Proceedings of the IEEE · doi:10.1109/jproc.2015.2494218 · Cited by 6,195
Differential Evolution: A Survey of the State-of-the-Art
Das, S., & Suganthan, P. N. (2011) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2010.2059031 · Cited by 5,307
Evolution strategies – A comprehensive introduction
Beyer, H.-G., & Schwefel, H. (2002) · Natural Computing · doi:10.1023/a:1015059928466 · Cited by 2,810
Metadata
- Authors
- Hansen, N., & Ostermeier, A.
- Affiliations
- Technische Universität Berlin (DE)
- ORCID
- Hansen, Nikolaus
- Venue
- Evolutionary Computation
- Publisher
- MIT Press
- Published
- 2001-06
- Volume
- 9
- Issue
- 2
- Pages
- 159-195
- ISSN
- 1063-6560 (ISSN-L)
- 1530-9304
- OpenAlex
- W2112036188
- Cited by
- 4,397
- References
- 41
- Citations by year
- 2026: 342 · 2025: 296 · 2024: 247 · 2023: 260 · 2022: 261 · 2021: 295 · 2020: 279 · 2019: 253 · 2018: 243 · 2017: 202 · 2016: 204 · 2015: 174 · 2014: 210 · 2013: 152 · 2012: 179
- FWCI
- 31.27
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Evolutionary Computation (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Metaheuristic Optimization Algorithms Research
- Physical Sciences › Computer Science › Artificial Intelligence › Evolutionary Algorithms and Applications
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Genetics › Evolution and Genetic Dynamics
- Keywords
- evolution strategies, self-adaptation, derandomization, covariance matrix adaptation, mutation distribution, cumulation, evolution path, global and local search
- MeSH terms
- Algorithms, Computer Simulation, Biological Evolution, Models, Genetic, Mutation, Stochastic Processes, Models, Statistical
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
