The DOI matches its Crossref record; 46 of the 46 references it cites were found in a registry or an index.
An easy-to-use real-world multi-objective optimization problem suite
Open accessAbstract
Although synthetic test problems are widely used for the performance assessment of evolutionary multi-objective optimization algorithms, they are likely to include unrealistic properties which may lead to overestimation/underestimation. To address this issue, we present a multi-objective optimization problem suite consisting of 16 bound-constrained real-world problems. The problem suite includes various problems in terms of the number of objectives, the shape of the Pareto front, and the type of design variables. 4 out of the 16 problems are multi-objective mixed-integer optimization problems. We provide Java, C, and Matlab source codes of the 16 problems so that they are available in an off-the-shelf manner. We examine an approximated Pareto front of each test problem. We also analyze the performance of six representative evolutionary multi-objective optimization algorithms on the 16 problems. In addition to the 16 problems, we present 8 constrained multi-objective real-world problems.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A fast and elitist multiobjective genetic algorithm: NSGA-II
Deb, K., Pratap, A., Agarwal, S., & Meyarivan, T. (2002) · IEEE Transactions on Evolutionary Computation · doi:10.1109/4235.996017 · Cited by 50,053
Multi-Objective Optimization Using Evolutionary Algorithms
Deb, K., & Kalyanmoy, D. (2001) · Andalas University Repository (Andalas University) · Cited by 17,326
MOEA/D: A Multiobjective Evolutionary Algorithm Based on Decomposition
Zhang, Q., & Li, H. (2007) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2007.892759 · Cited by 10,069
Deb, K., & Jain, H. (2014) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2013.2281535 · Cited by 7,133
Comparison of Multiobjective Evolutionary Algorithms: Empirical Results
Zitzler, E., Deb, K., & Thiele, L. (2000) · Evolutionary Computation · doi:10.1162/106365600568202 · Cited by 5,697
SPEA2: Improving the strength pareto evolutionary algorithm
Zitzler, E., Laumanns, M., & Thiele, L. (2001) · doi:10.3929/ethz-a-004284029 · Cited by 5,008
Performance assessment of multiobjective optimizers: an analysis and review
Zitzler, E., Thiele, L., Laumanns, M., Fonseca, C. M., & da Fonseca, V. G. (2003) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2003.810758 · Cited by 4,330
Simulated Binary Crossover for Continuous Search Space.
Deb, K., & Agrawal, R. B. (1995) · Complex Systems · Cited by 2,976
Das, I., & Dennis, J. E. (1998) · SIAM Journal on Optimization · doi:10.1137/s1052623496307510 · Cited by 2,654
Multiobjective Optimization Problems With Complicated Pareto Sets, MOEA/D and NSGA-II
Li, H., & Zhang, Q. (2009) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2008.925798 · Cited by 2,543
Multiobjective optimization using evolutionary algorithms — A comparative case study
Zitzler, E., & Thiele, L. (1998) · Lecture Notes in Computer Science · doi:10.1007/bfb0056872 · Cited by 2,262
Indicator-Based Selection in Multiobjective Search
Zitzler, E., & Künzli, S. (2004) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-30217-9_84 · Cited by 2,259
Jain, H., & Deb, K. (2014) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2013.2281534 · Cited by 2,172
A review of multiobjective test problems and a scalable test problem toolkit
Huband, S., Hingston, P., Barone, L., & While, L. (2006) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2005.861417 · Cited by 2,090
HypE: An Algorithm for Fast Hypervolume-Based Many-Objective Optimization
Bader, J., & Zitzler, E. (2011) · Evolutionary Computation · doi:10.1162/evco_a_00009 · Cited by 2,081
SMS-EMOA: Multiobjective selection based on dominated hypervolume
Beume, N., Naujoks, B., & Emmerich, M. (2007) · European Journal of Operational Research · doi:10.1016/j.ejor.2006.08.008 · Cited by 2,048
Scalable Test Problems for Evolutionary Multiobjective Optimization
Deb, K., Thiele, L., Laumanns, M., & Zitzler, E. (2005) · Advanced Information and Knowledge Processing · doi:10.1007/1-84628-137-7_6 · Cited by 2,010
Improving the search performance of SHADE using linear population size reduction
Tanabe, R., & Fukunaga, A. S. (2014) · 2014 IEEE Congress on Evolutionary Computation (CEC) · doi:10.1109/cec.2014.6900380 · Cited by 1,625
Self-citationAn Evolutionary Many-Objective Optimization Algorithm Based on Dominance and Decomposition
Li, K., Deb, K., Zhang, Q., & Kwong, S. (2015) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2014.2373386 · Cited by 1,208
jMetal: A Java framework for multi-objective optimization
Durillo, J. J., & Nebro, A. J. (2011) · Advances in Engineering Software · doi:10.1016/j.advengsoft.2011.05.014 · Cited by 1,134
Constraint-handling in nature-inspired numerical optimization: Past, present and future
Mezura-Montes, E., & Coello Coello, C. A. (2011) · Swarm and Evolutionary Computation · doi:10.1016/j.swevo.2011.10.001 · Cited by 1,127
ParamILS: An Automatic Algorithm Configuration Framework
Hutter, F., Hoos, H. H., Leyton-Brown, K., & Stuetzle, T. (2009) · Journal of Artificial Intelligence Research · doi:10.1613/jair.2861 · Cited by 882
A New Dominance Relation-Based Evolutionary Algorithm for Many-Objective Optimization
Yuan, Y., Xu, H., Wang, B., & Yao, X. (2016) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2015.2420112 · Cited by 752
Evolutionary dynamic optimization: A survey of the state of the art
Nguyen, T. T., Yang, S., & Branke, J. (2012) · Swarm and Evolutionary Computation · doi:10.1016/j.swevo.2012.05.001 · Cited by 656
Performance of Decomposition-Based Many-Objective Algorithms Strongly Depends on Pareto Front Shapes
Ishibuchi, H., Setoguchi, Y., Masuda, H., & Nojima, Y. (2017) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2016.2587749 · Cited by 592
Self-citationA Survey of Multiobjective Evolutionary Algorithms based on Decomposition
Trivedi, A., Srinivasan, D., Sanyal, K., & Ghosh, A. (2016) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2016.2608507 · Cited by 549
A Swarm Metaphor for Multiobjective Design Optimization
Ray, T., & Liew, K. M. (2002) · Engineering Optimization · doi:10.1080/03052150210915 · Cited by 431
Ponsich, A., Jaimes, A. L., & Coello, C. A. C. (2013) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2012.2196800 · Cited by 361
Multiobjective optimization for crash safety design of vehicles using stepwise regression model
Liao, X., Li, Q., Yang, X., Zhang, W., & Li, W. (2008) · Structural and Multidisciplinary Optimization · doi:10.1007/s00158-007-0163-x · Cited by 335
MULTIOBJECTIVE DESIGN OPTIMIZATION BY AN EVOLUTIONARY ALGORITHM
RAY, T., TAI, K., & SEOW, K. C. (2001) · Engineering Optimization · doi:10.1080/03052150108940926 · Cited by 294
Tušar, T., & Filipič, B. (2015) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2014.2313407 · Cited by 248
Jiang, S., & Yang, S. (2016) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2015.2403131 · Cited by 237
Performance comparison of NSGA-II and NSGA-III on various many-objective test problems
Ishibuchi, H., Imada, R., Setoguchi, Y., & Nojima, Y. (2016) · 2016 IEEE Congress on Evolutionary Computation (CEC) · doi:10.1109/cec.2016.7744174 · Cited by 212
Self-citationHua, Y., Jin, Y., & Hao, K. (2019) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2018.2834466 · Cited by 194
Redesigning the jMetal Multi-Objective Optimization Framework
Nebro, A. J., Durillo, J. J., & Vergne, M. (2015) · Proceedings of the Companion Publication of the 2015 Annual Conference on Genetic and Evolutionary Computation · doi:10.1145/2739482.2768462 · Cited by 186
Li, H., Deb, K., Zhang, Q., Suganthan, P. N., & Chen, L. (2019) · Swarm and Evolutionary Computation · doi:10.1016/j.swevo.2019.02.003 · Cited by 164
Multiobjective structural optimization using a microgenetic algorithm
Coello, C. A. C., & Toscano‐Pulido, G. (2005) · Structural and Multidisciplinary Optimization · doi:10.1007/s00158-005-0527-z · Cited by 163
How to Read Many-Objective Solution Sets in Parallel Coordinates [Educational Forum]
Li, M., Zhen, L., & Yao, X. (2017) · IEEE Computational Intelligence Magazine · doi:10.1109/mci.2017.2742869 · Cited by 136
Cheng, R., Rodemann, T., Fischer, M., Olhofer, M., & Jin, Y. (2017) · IEEE Transactions on Emerging Topics in Computational Intelligence · doi:10.1109/tetci.2017.2669104 · Cited by 118
Benchmarking Multi- and Many-Objective Evolutionary Algorithms Under Two Optimization Scenarios
Tanabe, R., Ishibuchi, H., & Oyama, A. (2017) · IEEE Access · doi:10.1109/access.2017.2751071 · Cited by 98
Self-citationImproving the multiobjective evolutionary algorithm based on decomposition with new penalty schemes
Yang, S., Jiang, S., & Jiang, Y. M. (2016) · Soft Computing · doi:10.1007/s00500-016-2076-3 · Cited by 87
A Review of Features and Limitations of Existing Scalable Multiobjective Test Suites
Martinez, S. Z., Coello, C. A. C., Aguirre, H. E., & Tanaka, K. (2018) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2018.2836912 · Cited by 74
Mixed-integer benchmark problems for single- and bi-objective optimization
Tušar, T., Brockhoff, D., & Hansen, N. (2019) · Genetic and Evolutionary Computation Conference (GECCO) · doi:10.1145/3321707.3321868 · Cited by 52
Regular Pareto Front Shape is not Realistic
Ishibuchi, H., He, L., & Shang, K. (2019) · IEEE Congress on Evolutionary Computation (CEC) · doi:10.1109/cec.2019.8790342 · Cited by 51
Self-citationSingle- and multi-objective game-benchmark for evolutionary algorithms
Volz, V., Naujoks, B., Kerschke, P., & Tušar, T. (2019) · Genetic and Evolutionary Computation Conference (GECCO) · doi:10.1145/3321707.3321805 · Cited by 39
CFD-Based Design Optimization For Single Element Rocket Injector
Vaidyanathan, R., Tucker, K., Papila, N., & Shyy, W. (2003) · AIAA Aerospace Sciences Meeting and Exhibit · doi:10.2514/6.2003-296 · Cited by 21
Cited by
Osaba, E., Villar-Rodriguez, E., Del Ser, J., Nebro, A. J., Molina, D., LaTorre, A., Suganthan, P. N., Coello Coello, C. A., & Herrera, F. (2021) · Swarm and Evolutionary Computation · doi:10.1016/j.swevo.2021.100888 · Cited by 406
Kumar, A., Wu, G., Ali, M. Z., Luo, Q., Mallipeddi, R., Suganthan, P. N., & Das, S. (2021) · Swarm and Evolutionary Computation · doi:10.1016/j.swevo.2021.100961 · Cited by 309
Benchmarking in Optimization: Best Practice and Open Issues
Bartz-Beielstein, T., Doerr, C., Berg, D. V. D., Bossek, J., Chandrasekaran, S., Eftimov, T., Fischbach, A., Kerschke, P., La Cava, W., Lopez-Ibanez, M., et al. (2020) · arXiv · doi:10.48550/arxiv.2007.03488 · Cited by 214
Metadata
- Authors
- Tanabe, R., & Ishibuchi, H.
- Venue
- Applied Soft Computing
- Publisher
- Elsevier BV
- Published
- 2020-04
- Volume
- 89
- Pages
- 106078
- ISSN
- 1568-4946 (ISSN-L)
- OpenAlex
- W2998757713
- Cited by
- 324
- References
- 46
- FWCI
- 16.68
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.