Solving Large-Scale Multiobjective Optimization Problems With Sparse Optimal Solutions via Unsupervised Neural Networks
The DOI matches its Crossref record; 55 of the 55 references it cites were found in a registry or an index.
Abstract
Due to the curse of dimensionality of search space, it is extremely difficult for evolutionary algorithms to approximate the optimal solutions of large-scale multiobjective optimization problems (LMOPs) by using a limited budget of evaluations. If the Pareto-optimal subspace is approximated during the evolutionary process, the search space can be reduced and the difficulty encountered by evolutionary algorithms can be highly alleviated. Following the above idea, this article proposes an evolutionary algorithm to solve sparse LMOPs by learning the Pareto-optimal subspace. The proposed algorithm uses two unsupervised neural networks, a restricted Boltzmann machine, and a denoising autoencoder to learn a sparse distribution and a compact representation of the decision variables, where the combination of the learnt sparse distribution and compact representation is regarded as an approximation of the Pareto-optimal subspace. The genetic operators are conducted in the learnt subspace, and the resultant offspring solutions then can be mapped back to the original search space by the two neural networks. According to the experimental results on eight benchmark problems and eight real-world problems, the proposed algorithm can effectively solve sparse LMOPs with 10000 decision variables by only 100000 evaluations.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
A fast and elitist multiobjective genetic algorithm: NSGA-II
Deb, K., Pratap, A., Agarwal, S., & Meyarivan, T. (2002) · IEEE Transactions on Evolutionary Computation · doi:10.1109/4235.996017 · Cited by 50,053
Fast algorithms for mining association rules
Agrawal, R., & Srikant, R. (1998) · Cited by 11,307
Multiobjective evolutionary algorithms: a comparative case study and the strength Pareto approach
Zitzler, E., & Thiele, L. (1999) · IEEE Transactions on Evolutionary Computation · doi:10.1109/4235.797969 · Cited by 8,798
Extracting and composing robust features with denoising autoencoders
Vincent, P., Larochelle, H., Bengio, Y., & Manzagol, P.-A. (2008) · Proceedings of the 25th international conference on Machine learning - ICML '08 · doi:10.1145/1390156.1390294 · Cited by 7,436
McKay, M. D., Beckman, R. J., & Conover, W. J. (2000) · Technometrics · doi:10.2307/1271432 · Cited by 7,415
Training Products of Experts by Minimizing Contrastive Divergence
Hinton, G. E. (2002) · Neural Computation · doi:10.1162/089976602760128018 · Cited by 4,879 · cited 1×
“, the difference between the reconstructed vector x′ and the original input x) by finding the optimal values of a, a′, and w, which can be achieved by the contrastive divergence algorithm [44].”
BackgroundPerformance assessment of multiobjective optimizers: an analysis and review
Zitzler, E., Thiele, L., Laumanns, M., Fonseca, C. M., & da Fonseca, V. G. (2003) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2003.810758 · Cited by 4,330
Dimensionality Reduction: A Comparative Review
van der Maaten, L. J. P., Postma, E. O., & van den Herik, H. J. (2009) · Cited by 3,256
Simulated Binary Crossover for Continuous Search Space.
Deb, K., & Agrawal, R. B. (1995) · Complex Systems · Cited by 2,976
Mckay, M. D., Beckman, R. J., & Conover, W. J. (2000) · Technometrics · doi:10.1080/00401706.2000.10485979 · Cited by 2,833
Platemo: a matlab platform for evolutionary multi-objective optimization [educational forum]
Tian, Y., Cheng, R., Zhang, X., & Jin, Y. (2017) · IEEE Computational Intelligence Magazine · doi:10.1109/mci.2017.2742868 · Cited by 2,777
Self-citationThe Network Data Repository with Interactive Graph Analytics and Visualization
Rossi, R., & Ahmed, N. (2015) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v29i1.9277 · Cited by 2,412
Neural networks and principal component analysis: Learning from examples without local minima
Baldi, P., & Hornik, K. (1989) · Neural Networks · doi:10.1016/0893-6080(89)90014-2 · Cited by 1,383 · cited 5×
“MaOEA-IT uses PCA to learn the Pareto optimal subspace according to a set of well-converged solutions.”
MethodInfluentialParticle swarm optimization for feature selection in classification: a multi-objective approach
Xue, B., Zhang, M., & Browne, W. N. (2013) · IEEE Transactions on Cybernetics · doi:10.1109/tsmcb.2012.2227469 · Cited by 1,282
A combined genetic adaptive search (GeneAS) for engineering design
Deb, K., & Goyal, M. K. (1996) · Cited by 1,229
A faster algorithm for calculating hypervolume
While, L., Hingston, P., Barone, L., & Huband, S. (2006) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2005.851275 · Cited by 1,100
RM-MEDA: A Regularity Model-Based Multiobjective Estimation of Distribution Algorithm
Zhang, Q., Zhou, A., & Jin, Y. (2008) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2007.894202 · Cited by 827
Self-citationZhang, X., Tian, Y., Cheng, R., & Jin, Y. (2018) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2016.2600642 · Cited by 660
Self-citationSMPSO: A new PSO-based metaheuristic for multi-objective optimization
Nebro, A. J., Durillo, J. J., Garcia-Nieto, J., Coello Coello, C. A., Luna, F., & Alba, E. (2009) · 2009 IEEE Symposium on Computational Intelligence in Multi-Criteria Decision-Making(MCDM) · doi:10.1109/mcdm.2009.4938830 · Cited by 651
An Introduction to Restricted Boltzmann Machines
Fischer, A., & Igel, C. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-33275-3_2 · Cited by 569
An Efficient Approach to Nondominated Sorting for Evolutionary Multiobjective Optimization
Zhang, X., Tian, Y., Cheng, R., & Jin, Y. (2015) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2014.2308305 · Cited by 531
Self-citationMa, X., Liu, F., Qi, Y., Wang, X., Li, L., Jiao, L., Yin, M., & Gong, M. (2016) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2015.2455812 · Cited by 523
Efficient Large-Scale Multiobjective Optimization Based on a Competitive Swarm Optimizer
Tian, Y., Zheng, X., Zhang, X., & Jin, Y. (2020) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2019.2906383 · Cited by 480
Self-citationPareto-Based Multiobjective Machine Learning: An Overview and Case Studies
Jin, Y., & Sendhoff, B. (2008) · IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews) · doi:10.1109/tsmcc.2008.919172 · Cited by 455
Self-citationAn Evolutionary Algorithm for Large-Scale Sparse Multiobjective Optimization Problems
Tian, Y., Zhang, X., Wang, C., & Jin, Y. (2020) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2019.2918140 · Cited by 440
Self-citationEvolutionary Multitasking via Explicit Autoencoding
Feng, L., Zhou, L., Zhong, J., Gupta, A., Ong, Y.-S., Tan, K.-C., & Qin, A. K. (2019) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2018.2845361 · Cited by 438
Self-citationA Multiobjective Evolutionary Algorithm Using Gaussian Process-Based Inverse Modeling
Cheng, R., Jin, Y., Narukawa, K., & Sendhoff, B. (2015) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2015.2395073 · Cited by 377
Self-citationA Framework for Large-Scale Multiobjective Optimization Based on Problem Transformation
Zille, H., Ishibuchi, H., Mostaghim, S., & Nojima, Y. (2018) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2017.2704782 · Cited by 377
Accelerating Large-Scale Multiobjective Optimization via Problem Reformulation
He, C., Li, L., Tian, Y., Zhang, X., Cheng, R., Jin, Y., & Yao, X. (2019) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2019.2896002 · Cited by 357
Self-citationAutoencoder and Its Various Variants
Zhai, J., Zhang, S., Chen, J., & He, Q. (2018) · 2018 IEEE International Conference on Systems, Man, and Cybernetics (SMC) · doi:10.1109/smc.2018.00080 · Cited by 339
The Critical Node Detection Problem in networks: A survey
Lalou, M., Tahraoui, M. A., & Kheddouci, H. (2018) · Computer Science Review · doi:10.1016/j.cosrev.2018.02.002 · Cited by 311
Use of cooperative coevolution for solving large scale multiobjective optimization problems
Antonio, L. M., & Coello, C. A. C. (2013) · 2013 IEEE Congress on Evolutionary Computation · doi:10.1109/cec.2013.6557903 · Cited by 276
Bayesian optimization in high dimensions via random embeddings
Wang, Z., Zoghi, M., Hutter, F., Matheson, D. S., & de Freitas, N. (2013) · UvA-DARE (University of Amsterdam) · Cited by 252
PlatEMO: A MATLAB Platform for Evolutionary Multi-Objective Optimization
Tian, Y., Cheng, R., Zhang, X., & Jin, Y. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1701.00879 · Cited by 235
Self-citationA New Representation in PSO for Discretization-Based Feature Selection
Tran, B., Xue, B., & Zhang, M. (2018) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2017.2714145 · Cited by 203
A learning-guided multi-objective evolutionary algorithm for constrained portfolio optimization
Lwin, K., Qu, R., & Kendall, G. (2014) · Applied Soft Computing · doi:10.1016/j.asoc.2014.08.026 · Cited by 193
Cao, C., Li, C., Yang, Q., Liu, Y., & Qu, T. (2018) · Journal of Cleaner Production · doi:10.1016/j.jclepro.2017.11.037 · Cited by 179
Evolving Unsupervised Deep Neural Networks for Learning Meaningful Representations
Sun, Y., Yen, G. G., & Zhang, Y. (2018) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2018.2808689 · Cited by 173
Multi-objective Feature Selection with NSGA II
Hamdani, T. M., Won, J.-M., Alimi, A. M., & Karray, F. (2007) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-71618-1_27 · Cited by 163
MOEA/HD: A Multiobjective Evolutionary Algorithm Based on Hierarchical Decomposition
Xu, H., Zeng, W., Zhang, D., & Zeng, X. (2017) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2017.2779450 · Cited by 143
An Evolutionary Algorithm Based on Minkowski Distance for Many-Objective Optimization
Xu, H., Zeng, W., Zeng, X., & Yen, G. G. (2019) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2018.2856208 · Cited by 143
A hybrid Firefly-Genetic Algorithm for the capacitated facility location problem
Rahmani, A., & MirHassani, S. A. (2014) · Information Sciences · doi:10.1016/j.ins.2014.06.002 · Cited by 141
A New Two-Stage Evolutionary Algorithm for Many-Objective Optimization
Sun, Y., Xue, B., Zhang, M., & Yen, G. G. (2018) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2018.2882166 · Cited by 139
Zhang, L., Pan, H., Su, Y., Zhang, X., & Niu, Y. (2017) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2017.2711038 · Cited by 128
Self-citationStructure Learning for Deep Neural Networks Based on Multiobjective Optimization
Liu, J., Gong, M., Miao, Q., Wang, X., & Li, H. (2017) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2017.2695223 · Cited by 116
Qian, C., Yu, Y., & Zhou, Z.-H. (2015) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v29i1.9579 · Cited by 94
Configuring Software Product Lines by Combining Many-Objective Optimization and SAT Solvers
Xiang, Y., Zhou, Y., Zheng, Z., & Li, M. (2017) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3176644 · Cited by 87
Solving High-Dimensional Multi-Objective Optimization Problems with Low Effective Dimensions
Qian, H., & Yu, Y. (2017) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v31i1.10664 · Cited by 81
An Evolutionary Multiobjective Optimization Based Fuzzy Method for Overlapping Community Detection
Tian, Y., Yang, S., & Zhang, X. (2019) · IEEE Transactions on Fuzzy Systems · doi:10.1109/tfuzz.2019.2945241 · Cited by 81
Self-citationZhao, J., Xu, Y. H., Luo, F., Dong, Z. Y., & Peng, Y. (2014) · Information Sciences · doi:10.1016/j.ins.2014.02.039 · Cited by 69
A Preference-Based Multiobjective Evolutionary Approach for Sparse Optimization
Li, H., Zhang, Q., Deng, J., & Xu, Z. (2017) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2017.2677973 · Cited by 69
Yang, J., & Liu, J. (2017) · IEEE Access · doi:10.1109/access.2017.2782814 · Cited by 55
Restricted Boltzmann machine based algorithm for multi-objective optimization
Tang, H., Shim, V. A., Tan, K. C., & Chia, J. Y. (2010) · IEEE Congress on Evolutionary Computation (CEC) · doi:10.1109/cec.2010.5586465 · Cited by 37
Self-citationA Black-Box Attack on Neural Networks Based on Swarm Evolutionary Algorithm
Liu, X., Hu, T., Ding, K., Bai, Y., Niu, W., & Lu, J. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-55304-3_14 · Cited by 21
Cited by
A Survey on Evolutionary Constrained Multiobjective Optimization
Liang, J., Ban, X., Yu, K., Qu, B., Qiao, K., Yue, C., Chen, K., & Tan, K. C. (2023) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2022.3155533 · Cited by 438
Self-citationEvolutionary Large-Scale Multi-Objective Optimization: A Survey
Tian, Y., Si, L., Zhang, X., Cheng, R., He, C., Tan, K. C., & Jin, Y. (2022) · ACM Computing Surveys · doi:10.1145/3470971 · Cited by 401
Self-citation
Metadata
- Authors
- Tian, Y., Lu, C., Zhang, X., Tan, K. C., & Jin, Y.
- Venue
- IEEE Transactions on Cybernetics
- Published
- 2021-06
- Volume
- 51
- Issue
- 6
- Pages
- 3115-3128
- ISSN
- 2168-2267 (ISSN-L)
- 2168-2275
- OpenAlex
- W3012911890
- Cited by
- 318
- References
- 55
- FWCI
- 16.56
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.