The DOI matches its Crossref record; 40 of the 40 references it cites were found in a registry or an index.
Committee-Based Active Learning for Surrogate-Assisted Particle Swarm Optimization of Expensive Problems
Abstract
Function evaluations (FEs) of many real-world optimization problems are time or resource consuming, posing a serious challenge to the application of evolutionary algorithms (EAs) to solve these problems. To address this challenge, the research on surrogate-assisted EAs has attracted increasing attention from both academia and industry over the past decades. However, most existing surrogate-assisted EAs (SAEAs) either still require thousands of expensive FEs to obtain acceptable solutions, or are only applied to very low-dimensional problems. In this paper, a novel surrogate-assisted particle swarm optimization (PSO) inspired from committee-based active learning (CAL) is proposed. In the proposed algorithm, a global model management strategy inspired from CAL is developed, which searches for the best and most uncertain solutions according to a surrogate ensemble using a PSO algorithm and evaluates these solutions using the expensive objective function. In addition, a local surrogate model is built around the best solution obtained so far. Then, a PSO algorithm searches on the local surrogate to find its optimum and evaluates it. The evolutionary search using the global model management strategy switches to the local search once no further improvement can be observed, and vice versa. This iterative search process continues until the computational budget is exhausted. Experimental results comparing the proposed algorithm with a few state-of-the-art SAEAs on both benchmark problems up to 30 decision variables as well as an airfoil design problem demonstrate that the proposed algorithm is able to achieve better or competitive solutions with a limited budget of hundreds of exact FEs.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A modified particle swarm optimizer
Shi, Y., & Eberhart, R. (2002) · 1998 IEEE International Conference on Evolutionary Computation Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98TH8360) · doi:10.1109/icec.1998.699146 · Cited by 10,229
Efficient Global Optimization of Expensive Black-Box Functions
Jones, D. R., Schonlau, M., & Welch, W. J. (1998) · Journal of Global Optimization · doi:10.1023/a:1008306431147 · Cited by 8,070 · cited 1×
“of a confidence level of the predicted fitness [25], they have recently become very popular in SAEAs.”
BackgroundDerrac, J., García, S., Molina, D., & Herrera, F. (2011) · Swarm and Evolutionary Computation · doi:10.1016/j.swevo.2011.02.002 · Cited by 5,512
Comparing inertia weights and constriction factors in particle swarm optimization
Eberhart, R. C., & Shi, Y. (2002) · Proceedings of the 2000 Congress on Evolutionary Computation. CEC00 (Cat. No.00TH8512) · doi:10.1109/cec.2000.870279 · Cited by 2,966
(2005) · Cited by 2,565
Large Sample Properties of Simulations Using Latin Hypercube Sampling
Stein, M. (1987) · Technometrics · doi:10.1080/00401706.1987.10488205 · Cited by 2,471
Seung, H. S., Opper, M., & Sompolinsky, H. (1992) · Proceedings of the fifth annual workshop on Computational learning theory · doi:10.1145/130385.130417 · Cited by 1,651
Surrogate-assisted evolutionary computation: Recent advances and future challenges
Jin, Y. (2011) · Swarm and Evolutionary Computation · doi:10.1016/j.swevo.2011.05.001 · Cited by 1,514
Self-citationKnowles, J. (2006) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2005.851274 · Cited by 1,254
A comprehensive survey of fitness approximation in evolutionary computation
Jin, Y. (2005) · Soft Computing · doi:10.1007/s00500-003-0328-5 · Cited by 1,229
Self-citationMulti-fidelity optimization via surrogate modelling
Forrester, A. I. J., Sóbester, A., & Keane, A. J. (2007) · Proceedings of the Royal Society A: Mathematical, Physical and Engineering Sciences · doi:10.1098/rspa.2007.1900 · Cited by 1,018
Single- and multiobjective evolutionary optimization assisted by Gaussian random field metamodels
Emmerich, M. T. M., Giannakoglou, K. C., & Naujoks, B. (2006) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2005.859463 · Cited by 759
Goel, T., Haftka, R. T., Shyy, W., & Queipo, N. V. (2006) · Structural and Multidisciplinary Optimization · doi:10.1007/s00158-006-0051-9 · Cited by 713
Nonlinear inertia weight variation for dynamic adaptation in particle swarm optimization
Chatterjee, A., & Siarry, P. (2006) · Computers & Operations Research · doi:10.1016/j.cor.2004.08.012 · Cited by 690
A framework for evolutionary optimization with approximate fitness functions
Jin, Y., Olhofer, M., & Sendhoff, B. (2002) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2002.800884 · Cited by 662
Self-citationChugh, T., Jin, Y., Miettinen, K., Hakanen, J., & Sindhya, K. (2018) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2016.2622301 · Cited by 625
Self-citationEvolutionary algorithms in control systems engineering: a survey
Fleming, P. J., & Purshouse, R. C. (2002) · Control Engineering Practice · doi:10.1016/s0967-0661(02)00081-3 · Cited by 619
Settles, B. (2012) · Synthesis Lectures on Artificial Intelligence and Machine Learning · doi:10.2200/s00429ed1v01y201207aim018 · Cited by 605
Liu, B., Zhang, Q., & Gielen, G. E. (2013) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2013.2248012 · Cited by 581
Generalizing Surrogate-Assisted Evolutionary Computation
Lim, D., Jin, Y., Ong, Y.-S., & Sendhoff, B. (2010) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2009.2027359 · Cited by 484
Self-citationMethods for Unconstrained Optimization Problems
O, J. M., Kowalik, J., & Osborne, M. R. (1970) · Mathematics of Computation · doi:10.2307/2004893 · Cited by 478
Combining Global and Local Surrogate Models to Accelerate Evolutionary Optimization
Zhou, Z., Ong, Y. S., Nair, P. B., Keane, A. J., & Lum, K. Y. (2007) · IEEE Transactions on Systems, Man and Cybernetics, Part C (Applications and Reviews) · doi:10.1109/tsmcc.2005.855506 · Cited by 429
Surrogate-Assisted Cooperative Swarm Optimization of High-Dimensional Expensive Problems
Sun, C., Jin, Y., Cheng, R., Ding, J., & Zeng, J. (2017) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2017.2675628 · Cited by 425
Self-citationDiverse ensembles for active learning
Melville, P., & Mooney, R. J. (2004) · Twenty-first international conference on Machine learning - ICML '04 · doi:10.1145/1015330.1015385 · Cited by 319
Diversity Assessment in Many-Objective Optimization
Wang, H., Jin, Y., & Yao, X. (2017) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2016.2550502 · Cited by 274
Self-citationRegis, R. G. (2014) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2013.2262111 · Cited by 268
Data-Driven Surrogate-Assisted Multiobjective Evolutionary Optimization of a Trauma System
Wang, H., Jin, Y., & Jansen, J. O. (2016) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2016.2555315 · Cited by 261
Self-citationActive learning: theory and applications
Koller, D., & Tong, S. (2001) · Cited by 210
A systems approach to evolutionary multiobjective structural optimization and beyond
Jin, Y., & Sendhoff, B. (2009) · IEEE Computational Intelligence Magazine · doi:10.1109/mci.2009.933094 · Cited by 191
Self-citationA two-layer surrogate-assisted particle swarm optimization algorithm
Sun, C., Jin, Y., Zeng, J., & Yu, Y. (2015) · Soft Computing · doi:10.1007/s00500-014-1283-z · Cited by 182
Self-citationFaster convergence by means of fitness estimation
Branke, J., & Schmidt, C. (2003) · Soft Computing · doi:10.1007/s00500-003-0329-4 · Cited by 169
Active Learning for Regression Based on Query by Committee
Burbidge, R., Rowland, J. J., & King, R. D. (2007) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-77226-2_22 · Cited by 160
Particle swarm with radial basis function surrogates for expensive black-box optimization
Regis, R. G. (2013) · Journal of Computational Science · doi:10.1016/j.jocs.2013.07.004 · Cited by 146
Chugh, T., Chakraborti, N., Sindhya, K., & Jin, Y. (2016) · Materials and Manufacturing Processes · doi:10.1080/10426914.2016.1269923 · Cited by 145
Self-citationComparison-Based Optimizers Need Comparison-Based Surrogates
Loshchilov, I., Schoenauer, M., & Sébag, M. (2010) · Springer eBooks · doi:10.1007/978-3-642-15844-5_37 · Cited by 112
A study on metamodeling techniques, ensembles, and multi-surrogates in evolutionary computation
Lim, D., Ong, Y.-S., Jin, Y., & Sendhoff, B. (2007) · Genetic and Evolutionary Computation Conference (GECCO) · doi:10.1145/1276958.1277203 · Cited by 104
Self-citationPonweiser, W., Wagner, T., & Vincze, M. (2008) · IEEE Congress on Evolutionary Computation (CEC) · doi:10.1109/cec.2008.4631273 · Cited by 89
Small data driven evolutionary multi-objective optimization of fused magnesium furnaces
Guo, D., Chai, T., Ding, J., & Jin, Y. (2016) · IEEE Symposium Series on Computational Intelligence (SSCI) · doi:10.1109/ssci.2016.7850211 · Cited by 73
Self-citationSun, C., Ding, J., Zeng, J., & Jin, Y. (2016) · Memetic Computing · doi:10.1007/s12293-016-0199-9 · Cited by 61
Self-citationA New Repair Method For Constrained Optimization
Koch, P. N., Bagheri, S., Konen, W., Foussette, C., Krause, P., & Bäck, T. (2015) · Genetic and Evolutionary Computation Conference (GECCO) · doi:10.1145/2739480.2754658 · Cited by 36
Cited by
Data-Driven Evolutionary Optimization: An Overview and Case Studies
Jin, Y., Wang, H., Chugh, T., Guo, D., & Miettinen, K. (2019) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2018.2869001 · Cited by 686
Self-citationMajor Advances in Particle Swarm Optimization: Theory, Analysis, and Application
Houssein, E. H., Gad, A. G., Hussain, K., & Suganthan, P. N. (2021) · Swarm and Evolutionary Computation · doi:10.1016/j.swevo.2021.100868 · Cited by 466
RetractedA survey on evolutionary computation for complex continuous optimization
Zhan, Z.-H., Shi, L., Tan, K. C., & Zhang, J. (2022) · Artificial Intelligence Review · doi:10.1007/s10462-021-10042-y · Cited by 416
Surrogate-assisted hierarchical particle swarm optimization
Yu, H., Tan, Y., Zeng, J., Sun, C., & Jin, Y. (2018) · Information Sciences · doi:10.1016/j.ins.2018.04.062 · Cited by 313
Self-citationSun, Y., Wang, H., Xue, B., Jin, Y., Yen, G. G., & Zhang, M. (2020) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2019.2924461 · Cited by 290
Self-citation
Metadata
- Authors
- Wang, H., Jin, Y., & Doherty, J.
- Venue
- IEEE Transactions on Cybernetics
- Published
- 2017-09
- Volume
- 47
- Issue
- 9
- Pages
- 2664-2677
- ISSN
- 2168-2267 (ISSN-L)
- 2168-2275
- OpenAlex
- W2679717297
- Cited by
- 415
- References
- 40
- FWCI
- 20.14
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.