The DOI matches its Crossref record; 119 of the 119 references it cites were found in a registry or an index.
Quality Evaluation of Solution Sets in Multiobjective Optimisation: A Survey
Open accessAbstract
Complexity and variety of modern multiobjective optimisation problems result in the emergence of numerous search techniques, from traditional mathematical programming to various randomised heuristics. A key issue raised consequently is how to evaluate and compare solution sets generated by these multiobjective search techniques. In this article, we provide a comprehensive review of solution set quality evaluation. Starting with an introduction of basic principles and concepts of set quality evaluation, this article summarises and categorises 100 state-of-the-art quality indicators, with the focus on what quality aspects these indicators reflect. This is accompanied in each category by detailed descriptions of several representative indicators and in-depth analyses of their strengths and weaknesses. Furthermore, issues regarding attributes that indicators possess and properties that indicators are desirable to have are discussed, in the hope of motivating researchers to look into these important issues when designing quality indicators and of encouraging practitioners to bear these issues in mind when selecting/using quality indicators. Finally, future trends and potential research directions in the area are suggested, together with some guidelines on these directions.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A fast and elitist multiobjective genetic algorithm: NSGA-II
Deb, K., Pratap, A., Agarwal, S., & Meyarivan, T. (2002) · IEEE Transactions on Evolutionary Computation · doi:10.1109/4235.996017 · Cited by 50,053
Genetic algorithms in search, optimization, and machine learning
(1989) · Choice Reviews Online · doi:10.5860/choice.27-0936 · Cited by 49,010
Genetic Algorithms in Search, Optimization and Machine Learning
Goldberg, D. E., & Robson, D. (1988) · Cited by 18,391
Multiobjective evolutionary algorithms: a comparative case study and the strength Pareto approach
Zitzler, E., & Thiele, L. (1999) · IEEE Transactions on Evolutionary Computation · doi:10.1109/4235.797969 · Cited by 8,798
Muiltiobjective Optimization Using Nondominated Sorting in Genetic Algorithms
Srinivas, N., & Deb, K. (1994) · Evolutionary Computation · doi:10.1162/evco.1994.2.3.221 · Cited by 6,935
Comparison of Multiobjective Evolutionary Algorithms: Empirical Results
Zitzler, E., Deb, K., & Thiele, L. (2000) · Evolutionary Computation · doi:10.1162/106365600568202 · Cited by 5,697
Evolutionary Algorithms for Solving Multi-Objective Problems
(2007) · Genetic and Evolutionary Computation Series · doi:10.1007/978-0-387-36797-2 · Cited by 5,686
A Fast Elitist Non-dominated Sorting Genetic Algorithm for Multi-objective Optimization: NSGA-II
Deb, K., Agrawal, S., Pratap, A., & Meyarivan, T. (2000) · Lecture Notes in Computer Science · doi:10.1007/3-540-45356-3_83 · Cited by 5,289
Nonlinear Multiobjective Optimization
Miettinen, K. (1998) · International Series in Operations Research & Management Science · doi:10.1007/978-1-4615-5563-6 · Cited by 4,710
Handling multiple objectives with particle swarm optimization
Coello, C. A. C., Pulido, G. T., & Lechuga, M. S. (2004) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2004.826067 · Cited by 4,455
Performance assessment of multiobjective optimizers: an analysis and review
Zitzler, E., Thiele, L., Laumanns, M., Fonseca, C. M., & da Fonseca, V. G. (2003) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2003.810758 · Cited by 4,330
Nonlinear Multiobjective Optimization
Mardle, S., & Miettinen, K. M. (2000) · The Journal of the Operational Research Society · doi:10.2307/254267 · Cited by 3,049
Proceedings of the International Joint Conference on Artificial Intelligence 2007
Bundy, A. (2007) · International Joint Conference on Artificial Intelligence · Cited by 2,761
Evolutionary Algorithms for Solving Multi-Objective Problems
Coello Coello, C. A., Van Veldhuizen, D. A., & Lamont, G. B. (2002) · Genetic Algorithms and Evolutionary Computation · doi:10.1007/978-1-4757-5184-0 · Cited by 2,663
An Overview of Evolutionary Algorithms in Multiobjective Optimization
Fonseca, C. M., & Fleming, P. J. (1995) · Evolutionary Computation · doi:10.1162/evco.1995.3.1.1 · Cited by 2,266
Multiobjective optimization using evolutionary algorithms — A comparative case study
Zitzler, E., & Thiele, L. (1998) · Lecture Notes in Computer Science · doi:10.1007/bfb0056872 · Cited by 2,262
Indicator-Based Selection in Multiobjective Search
Zitzler, E., & Künzli, S. (2004) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-30217-9_84 · Cited by 2,259
Multiobjective evolutionary algorithms: A survey of the state of the art
Zhou, A., Qu, B.-Y., Li, H., Zhao, S.-Z., Suganthan, P. N., & Zhang, Q. (2011) · Swarm and Evolutionary Computation · doi:10.1016/j.swevo.2011.03.001 · Cited by 2,255
(2017) · Encyclopedia of Machine Learning and Data Mining · doi:10.1007/978-1-4899-7687-1_100317 · Cited by 2,127
HypE: An Algorithm for Fast Hypervolume-Based Many-Objective Optimization
Bader, J., & Zitzler, E. (2011) · Evolutionary Computation · doi:10.1162/evco_a_00009 · Cited by 2,081
SMS-EMOA: Multiobjective selection based on dominated hypervolume
Beume, N., Naujoks, B., & Emmerich, M. (2007) · European Journal of Operational Research · doi:10.1016/j.ejor.2006.08.008 · Cited by 2,048
Evolutionary algorithms for multiobjective optimization: methods and applications
Zitzler, E. (1999) · doi:10.3929/ethz-a-003856832 · Cited by 1,965
Proceedings of the Genetic and Evolutionary Computation Conference, GECCO 2019
Auger, A., & Stützle, T. (2019) · Dépôt institutionnel de l'Université libre de Bruxelles (Université Libre de Bruxelles) · Cited by 1,749
Evolutionary Algorithms for Solving Multi-Objective Problems (Genetic and Evolutionary Computation)
Coello, C. A. C., Lamont, G. B., & Veldhuizen, D. A. V. (2006) · Springer eBooks · Cited by 1,631
Knowles, J., & Corne, D. (2003) · Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406) · doi:10.1109/cec.1999.781913 · Cited by 1,278
Multiobjective evolutionary algorithms: classifications, analyses, and new innovations
Lamont, G. B., & Veldhuizen, D. A. V. (1999) · Cited by 1,212
The balance between proximity and diversity in multiobjective evolutionary algorithms
Bosman, P. A. N., & Thierens, D. (2003) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2003.810761 · Cited by 1,154
A faster algorithm for calculating hypervolume
While, L., Hingston, P., Barone, L., & Huband, S. (2006) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2005.851275 · Cited by 1,100
A multi-objective genetic local search algorithm and its application to flowshop scheduling
Ishibuchi, H., & Murata, T. (1998) · IEEE Transactions on Systems, Man and Cybernetics, Part C (Applications and Reviews) · doi:10.1109/5326.704576 · Cited by 1,019
Evolutionary many-objective optimization: A short review
Ishibuchi, H., Tsukamoto, N., & Nojima, Y. (2008) · 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence) · doi:10.1109/cec.2008.4631121 · Cited by 914
A Grid-Based Evolutionary Algorithm for Many-Objective Optimization
Yang, S., Li, M., Liu, X., & Zheng, J. (2013) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2012.2227145 · Cited by 893
Self-citationWallenius, J., Dyer, J. S., Fishburn, P. C., Steuer, R. E., Zionts, S., & Deb, K. (2008) · Management Science · doi:10.1287/mnsc.1070.0838 · Cited by 839
Many-Objective Evolutionary Algorithms: A Survey
Li, B., Li, J., Tang, K., & Yao, X. (2015) · ACM Computing Surveys · doi:10.1145/2792984 · Cited by 815
Self-citationCzyzżak, P., & Jaszkiewicz, A. (1998) · Journal of Multi‐Criteria Decision Analysis · doi:10.1002/(sici)1099-1360(199801)7:1<34::aid-mcda161>3.0.co;2-6 · Cited by 793
Covariance Matrix Adaptation for Multi-objective Optimization
Igel, C., Hansen, N., & Roth, S. (2007) · Evolutionary Computation · doi:10.1162/evco.2007.15.1.1 · Cited by 788
Improving PSO-Based Multi-objective Optimization Using Crowding, Mutation and ∈-Dominance
Sierra, M. R., & Coello Coello, C. A. (2005) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-31880-4_35 · Cited by 779
An updated survey of GA-based multiobjective optimization techniques
Coello, C. A. (2000) · ACM Computing Surveys · doi:10.1145/358923.358929 · Cited by 773
Ishibuchi, H., Yoshida, T., & Murata, T. (2003) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2003.810752 · Cited by 773
Proceedings of the 2000 Congress on Evolutionary Computation
(2000) · Proceedings of the 2000 Congress on Evolutionary Computation. CEC00 (Cat. No.00TH8512) · doi:10.1109/cec.2000.870267 · Cited by 766
Modified Distance Calculation in Generational Distance and Inverted Generational Distance
Ishibuchi, H., Masuda, H., Tanigaki, Y., & Nojima, Y. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-15892-1_8 · Cited by 739
Shift-Based Density Estimation for Pareto-Based Algorithms in Many-Objective Optimization
Li, M., Yang, S., & Liu, X. (2014) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2013.2262178 · Cited by 714
Self-citationTian, Y., Cheng, R., Zhang, X., Cheng, F., & Jin, Y. (2018) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2017.2749619 · Cited by 699
Deb, K., Mohan, M., & Mishra, S. (2005) · Evolutionary Computation · doi:10.1162/106365605774666895 · Cited by 637
An EMO Algorithm Using the Hypervolume Measure as Selection Criterion
Emmerich, M., Beume, N., & Naujoks, B. (2005) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-31880-4_5 · Cited by 604
Multi-objective meta-heuristics: An overview of the current state-of-the-art
Jones, D. F., Mirrazavi, S. K., & Tamiz, M. (2002) · European Journal of Operational Research · doi:10.1016/s0377-2217(01)00123-0 · Cited by 567
On metrics for comparing nondominated sets
Knowles, J., & Corne, D. (2003) · Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600) · doi:10.1109/cec.2002.1007013 · Cited by 560
A Survey of Multiobjective Evolutionary Algorithms based on Decomposition
Trivedi, A., Srinivasan, D., Sanyal, K., & Ghosh, A. (2016) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2016.2608507 · Cited by 549
Schutze, O., Esquivel, X., Lara, A., & Coello, C. A. C. (2012) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2011.2161872 · Cited by 511
From evolutionary computation to the evolution of things
Eiben, A. E., & Smith, J. (2015) · Nature · doi:10.1038/nature14544 · Cited by 496
On the approximability of trade-offs and optimal access of Web sources
Papadimitriou, C. H., & Yannakakis, M. (2002) · Proceedings 41st Annual Symposium on Foundations of Computer Science · doi:10.1109/sfcs.2000.892068 · Cited by 458
On the Evolutionary Optimization of Many Conflicting Objectives
Purshouse, R. C., & Fleming, P. J. (2007) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2007.910138 · Cited by 451
Performance metrics in multi-objective optimization
Riquelme, N., Von Lucken, C., & Baran, B. (2015) · 2015 Latin American Computing Conference (CLEI) · doi:10.1109/clei.2015.7360024 · Cited by 444
A Survey of Multiobjective Evolutionary Algorithms for Data Mining: Part I
Mukhopadhyay, A., Maulik, U., Bandyopadhyay, S., & Coello, C. A. C. (2014) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2013.2290086 · Cited by 421
MOSA method: a tool for solving multiobjective combinatorial optimization problems
Ulungu, E. L., Teghem, J., Fortemps, P. H., & Tuyttens, D. (1999) · Journal of Multi-Criteria Decision Analysis · doi:10.1002/(sici)1099-1360(199907)8:4<221::aid-mcda247>3.0.co;2-o · Cited by 385
On the performance assessment and comparison of stochastic multiobjective optimizers
Fonseca, C. M., & Fleming, P. J. (1996) · Lecture Notes in Computer Science · doi:10.1007/3-540-61723-x_1022 · Cited by 378
Theory of the hypervolume indicator: optimal μ-distributions and the choice of the reference point
Auger, A., Bader, J., Brockhoff, D., & Zitzler, E. (2009) · Proceedings of the tenth ACM SIGEVO workshop on Foundations of genetic algorithms · doi:10.1145/1527125.1527138 · Cited by 375
Ponsich, A., Jaimes, A. L., & Coello, C. A. C. (2013) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2012.2196800 · Cited by 361
Consistencies and Contradictions of Performance Metrics in Multiobjective Optimization
Jiang, S., Ong, Y.-S., Zhang, J., & Feng, L. (2014) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2014.2307319 · Cited by 314
Quality Assessment of Pareto Set Approximations
Zitzler, E., Knowles, J., & Thiele, L. (2008) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-88908-3_14 · Cited by 313
Zhou, A., Jin, Y., Zhang, Q., Sendhoff, B., & Tsang, E. (2006) · 2006 IEEE International Conference on Evolutionary Computation · doi:10.1109/cec.2006.1688406 · Cited by 303
Properties of an adaptive archiving algorithm for storing nondominated vectors
Knowles, J., & Corne, D. (2003) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2003.810755 · Cited by 303
A critical survey of performance indices for multi-objective optimisation
Okabe, T., Jin, Y., & Sendhoff, B. (2004) · The 2003 Congress on Evolutionary Computation, 2003. CEC '03. · doi:10.1109/cec.2003.1299759 · Cited by 278
Metrics for Quality Assessment of a Multiobjective Design Optimization Solution Set
Wu, J., & Azarm, S. (2001) · Journal of Mechanical Design · doi:10.1115/1.1329875 · Cited by 274
Diversity Assessment in Many-Objective Optimization
Wang, H., Jin, Y., & Yao, X. (2017) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2016.2550502 · Cited by 274
Self-citationDiversity Management in Evolutionary Many-Objective Optimization
Adra, S. F., & Fleming, P. J. (2011) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2010.2058117 · Cited by 262
A Simple and Fast Hypervolume Indicator-Based Multiobjective Evolutionary Algorithm
Jiang, S., Zhang, J., Ong, Y.-S., Zhang, A. N., & Tan, P. S. (2015) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2014.2367526 · Cited by 259
Stochastic Ranking Algorithm for Many-Objective Optimization Based on Multiple Indicators
Li, B., Tang, K., Li, J., & Yao, X. (2016) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2016.2549267 · Cited by 249
Self-citationTušar, T., & Filipič, B. (2015) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2014.2313407 · Cited by 248
Lotov, A. V., Bushenkov, V. A., & Kamenev, G. K. (2004) · Applied optimization · doi:10.1007/978-1-4419-8851-5 · Cited by 245
Normal Constraint Method with Guarantee of Even Representation of Complete Pareto Frontier
Messac, A., & Mattson, C. A. (2004) · AIAA Journal · doi:10.2514/1.8977 · Cited by 242
Bi-goal evolution for many-objective optimization problems
Li, M., Yang, S., & Liu, X. (2015) · Artificial Intelligence · doi:10.1016/j.artint.2015.06.007 · Cited by 239
Self-citationHow to Specify a Reference Point in Hypervolume Calculation for Fair Performance Comparison
Ishibuchi, H., Imada, R., Setoguchi, Y., & Nojima, Y. (2018) · Evolutionary Computation · doi:10.1162/evco_a_00226 · Cited by 237
Improved Metaheuristic Based on the R2 Indicator for Many-Objective Optimization
Hernández Gómez, R., & Coello Coello, C. A. (2015) · Proceedings of the 2015 Annual Conference on Genetic and Evolutionary Computation · doi:10.1145/2739480.2754776 · Cited by 235
Hadka, D., & Reed, P. (2012) · Evolutionary Computation · doi:10.1162/evco_a_00053 · Cited by 213
Multiobjective GAs, Quantitative Indices, and Pattern Classification
Bandyopadhyay, S., Pal, S. K., & Aruna, B. (2004) · IEEE Transactions on Systems, Man and Cybernetics, Part B (Cybernetics) · doi:10.1109/tsmcb.2004.834438 · Cited by 209
Performance Metric Ensemble for Multiobjective Evolutionary Algorithms
Yen, G. G., & He, Z. (2014) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2013.2240687 · Cited by 207
Normal Constraint Method with Guarantee of Even Representation of Complete Pareto Frontier
Messac, A., & Mattson, C. (2004) · 45th AIAA/ASME/ASCE/AHS/ASC Structures, Structural Dynamics & Materials Conference · doi:10.2514/6.2004-1679 · Cited by 199
An Investigation on Noisy Environments in Evolutionary Multiobjective Optimization
Goh, C. K., & Tan, K. C. (2007) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2006.882428 · Cited by 186
Tian, Y., Cheng, R., Zhang, X., Li, M., & Jin, Y. (2019) · IEEE Computational Intelligence Magazine · doi:10.1109/mci.2019.2919398 · Cited by 186
Self-citationOn the properties of the R2 indicator
Brockhoff, D., Wagner, T., & Trautmann, H. (2012) · Proceedings of the 14th annual conference on Genetic and evolutionary computation · doi:10.1145/2330163.2330230 · Cited by 178
$I_{\rm SDE}$ +—An Indicator for Multi and Many-Objective Optimization
Pamulapati, T., Mallipeddi, R., & Suganthan, P. N. (2019) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2018.2848921 · Cited by 177
Diversity Comparison of Pareto Front Approximations in Many-Objective Optimization
Li, M., Yang, S., & Liu, X. (2014) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2014.2310651 · Cited by 172
Self-citationA multi-objective evolutionary algorithm based on an enhanced inverted generational distance metric
Tian, Y., Zhang, X., Cheng, R., & Jin, Y. (2016) · IEEE Congress on Evolutionary Computation (CEC) · doi:10.1109/cec.2016.7748352 · Cited by 159
Visualization and Performance Metric in Many-Objective Optimization
He, Z., & Yen, G. G. (2015) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2015.2472283 · Cited by 157
Survey of methods to visualize alternatives in multiple criteria decision making problems
Miettinen, K. (2012) · OR Spectrum · doi:10.1007/s00291-012-0297-0 · Cited by 151
Reference Point Specification in Inverted Generational Distance for Triangular Linear Pareto Front
Ishibuchi, H., Imada, R., Setoguchi, Y., & Nojima, Y. (2018) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2017.2776226 · Cited by 151
Subset selection by Pareto optimization
Qian, C., Yu, Y., & Zhou, Z. (2015) · Cited by 142
MOMBI: A new metaheuristic for many-objective optimization based on the R2 indicator
Gómez, R. H., & Coello, C. A. C. (2013) · IEEE Congress on Evolutionary Computation (CEC) · doi:10.1109/cec.2013.6557868 · Cited by 140
A New Two-Stage Evolutionary Algorithm for Many-Objective Optimization
Sun, Y., Xue, B., Zhang, M., & Yen, G. G. (2018) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2018.2882166 · Cited by 139
How to Read Many-Objective Solution Sets in Parallel Coordinates [Educational Forum]
Li, M., Zhen, L., & Yao, X. (2017) · IEEE Computational Intelligence Magazine · doi:10.1109/mci.2017.2742869 · Cited by 136
Self-citationR2-IBEA: R2 indicator based evolutionary algorithm for multiobjective optimization
Phan, D. H., & Suzuki, J. (2013) · IEEE Congress on Evolutionary Computation (CEC) · doi:10.1109/cec.2013.6557783 · Cited by 127
Visualizing Mutually Nondominating Solution Sets in Many-Objective Optimization
Walker, D. J., Everson, R., & Fieldsend, J. E. (2012) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2012.2225064 · Cited by 124
Wang, S., Ali, S., Yue, T., Li, Y., & Liaaen, M. C. (2016) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1145/2884781.2884880 · Cited by 115
Ishibuchi, H., Masuda, H., Tanigaki, Y., & Nojima, Y. (2014) · IEEE Symposium on Computational Intelligence in Multi-Criteria Decision-Making (MCDM) · doi:10.1109/mcdm.2014.7007204 · Cited by 104
Hierons, R. M., Li, M., Liu, X., Segura, S., & Zheng, W. (2016) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/2897760 · Cited by 103
Self-citationMultiobjective A * search with consistent heuristics
Mandow, L., & Cruz, J. L. P. D. L. (2008) · Journal of the ACM · doi:10.1145/1754399.1754400 · Cited by 100
Reference point specification in hypervolume calculation for fair comparison and efficient search
Ishibuchi, H., Imada, R., Setoguchi, Y., & Nojima, Y. (2017) · Genetic and Evolutionary Computation Conference (GECCO) · doi:10.1145/3071178.3071264 · Cited by 100
2 Indicator-Based Multiobjective Search
Brockhoff, D., Wagner, T., & Trautmann, H. (2014) · Evolutionary Computation · doi:10.1162/evco_a_00135 · Cited by 97
A Study on Performance Evaluation Ability of a Modified Inverted Generational Distance Indicator
Ishibuchi, H., Masuda, H., & Nojima, Y. (2015) · Genetic and Evolutionary Computation Conference (GECCO) · doi:10.1145/2739480.2754792 · Cited by 97
Multiline Distance Minimization: A Visualized Many-Objective Test Problem Suite
Li, M., Groşan, C., Yang, S., Liu, X., & Yao, X. (2017) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2017.2655451 · Cited by 92
Self-citationConfiguring Software Product Lines by Combining Many-Objective Optimization and SAT Solvers
Xiang, Y., Zhou, Y., Zheng, Z., & Li, M. (2017) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3176644 · Cited by 87
Self-citationIshibuchi, H., Tsukamoto, N., Sakane, Y., & Nojima, Y. (2010) · Genetic and Evolutionary Computation Conference (GECCO) · doi:10.1145/1830483.1830578 · Cited by 86
A new performance metric for user-preference based multi-objective evolutionary algorithms
Mohammadi, A., Omidvar, M. N., & Li, X. (2013) · IEEE Congress on Evolutionary Computation (CEC) · doi:10.1109/cec.2013.6557912 · Cited by 78
The Value of Online Adaptive Search: A Performance Comparison of NSGAII, ε-NSGAII and εMOEA
Kollat, J. B., & Reed, P. M. (2005) · Lecture notes in computer science · doi:10.1007/978-3-540-31880-4_27 · Cited by 76
Spread Assessment for Evolutionary Multi-Objective Optimization
Li, M., & Zheng, J. (2009) · Lecture notes in computer science · doi:10.1007/978-3-642-01020-0_20 · Cited by 76
Self-citationApproximating the least hypervolume contributor: NP-hard in general, but fast in practice
Bringmann, K., & Friedrich, T. (2010) · Theoretical Computer Science · doi:10.1016/j.tcs.2010.09.026 · Cited by 71
Inselberg, A., & Dimsdale, B. (1991) · Springer eBooks · doi:10.1007/978-1-4684-5883-1_9 · Cited by 67
Study of preference relations in many-objective optimization
Jáimes, A. L., & Coello, C. A. C. (2009) · Genetic and Evolutionary Computation Conference (GECCO) · doi:10.1145/1569901.1569986 · Cited by 66
Eskandari, H., Geiger, C. D., & Lamont, G. B. (2007) · Springer eBooks · doi:10.1007/978-3-540-70928-2_14 · Cited by 65
Collette, Y., & Siarry, P. (2003) · Computers & Operations Research · doi:10.1016/j.cor.2003.08.017 · Cited by 61
A diversity indicator based on reference vectors for many-objective optimization
Cai, X., Sun, H., & Fan, Z. (2017) · Information Sciences · doi:10.1016/j.ins.2017.11.051 · Cited by 61
U-measure: A quality measure for multiobjective programming
Leung, Y.-W., & Wang, Y. (2003) · IEEE Transactions on Systems Man and Cybernetics - Part A Systems and Humans · doi:10.1109/tsmca.2003.817059 · Cited by 52
A Performance Comparison Indicator for Pareto Front Approximations in Many-Objective Optimization
Li, M., Yang, S., & Liu, X. (2015) · Genetic and Evolutionary Computation Conference (GECCO) · doi:10.1145/2739480.2754687 · Cited by 46
Self-citationFarhang-Mehr, A., & Azarm, S. (2003) · Journal of Mechanical Design · doi:10.1115/1.1623186 · Cited by 45
Speeding up many-objective optimization by Monte Carlo approximations
Bringmann, K., Friedrich, T., Igel, C., & Voß, T. (2013) · Artificial Intelligence · doi:10.1016/j.artint.2013.08.001 · Cited by 38
A New Approach on Many Objective Diversity Measurement
Mostaghim, S., & Teich, J. (2005) · Repository for Publications and Research Data (ETH Zurich) · doi:10.3929/ethz-b-000051614 · Cited by 25
Lizárraga, G., Hernández-Aguirre, A., & Botello‐Rionda, S. (2008) · Genetic and Evolutionary Computation Conference (GECCO) · doi:10.1145/1389095.1389227 · Cited by 23
Guest Editorial: Special Issue on Advances in Multiobjective Evolutionary Algorithms for Data Mining
Bandyopadhyay, S., Maulik, U., Coello, C. A. C., & Witold Pedrycz, C. (2014) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2013.2292181 · Cited by 15
A Bayesian Approach to Portfolio Selection in Multicriteria Group Decision Making
Emmerich, M., Deutz, A. H., & Yevseyeva, I. (2015) · Procedia Computer Science · doi:10.1016/j.procs.2015.08.618 · Cited by 8
Cited by
Performance assessment of the metaheuristic optimization algorithms: an exhaustive review
Halim, A. H., Ismail, I., & Das, S. (2021) · Artificial Intelligence Review · doi:10.1007/s10462-020-09906-6 · Cited by 293
Metadata
- Authors
- Li, M., & Yao, X.
- Venue
- ACM Computing Surveys
- Published
- 2019-03-18
- Volume
- 52
- Issue
- 2
- Pages
- 1-38
- ISSN
- 0360-0300 (ISSN-L)
- 1557-7341
- OpenAlex
- W2921981915
- Cited by
- 342
- References
- 119
- FWCI
- 27.01
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.