Evolutionary Transfer Optimization - A New Frontier in Evolutionary Computation Research
The DOI matches its Crossref record; 77 of the 77 references it cites were found in a registry or an index.
Abstract
The evolutionary algorithm (EA) is a nature-inspired population-based search method that works on Darwinian principles of natural selection. Due to its strong search capability and simplicity of implementation, EA has been successfully applied to solve many complex optimization problems, which cannot be easily solved by traditional exact mathematical approaches, such as linear programming, quadratic programming, and convex optimization. Despite its great success, it is worth noting that traditional EA solvers start the search from scratch by assuming zero prior knowledge about the task at hand. However, as problems seldom exist in isolation, solving one problem may yield useful information for solving other related problems. There has been growing interest in conducting research on evolutionary transfer optimization (ETO) in recent years: a paradigm that integrates EA solvers with knowledge learning and transfer across related domains to achieve better optimization efficiency and performance. This paper provides an overview of existing works of ETO based on the type of problems being solved by these methods, which are ETO for Optimization in Uncertain Environment, ETO for Multitask Optimization, ETO for Complex Optimization, ETO for Multi/Many-Objective Optimization, and ETO for Machine Learning Applications. The paper also highlights some of the challenges faced in this emerging research field of computational intelligence and discusses some promising future research directions in ETO. It is hoped that the study presented in this paper can help to inspire the development of more advanced ETO methods and applications.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Boyd, S., & Vandenberghe, L. (2004) · doi:10.1017/cbo9780511804441 · Cited by 56,601
A fast and elitist multiobjective genetic algorithm: NSGA-II
Deb, K., Pratap, A., Agarwal, S., & Meyarivan, T. (2002) · IEEE Transactions on Evolutionary Computation · doi:10.1109/4235.996017 · Cited by 50,053
Genetic algorithms in search, optimization, and machine learning
(1989) · Choice Reviews Online · doi:10.5860/choice.27-0936 · Cited by 49,010
Pan, S. J., & Yang, Q. (2010) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2009.191 · Cited by 23,387 · cited 3×
“In machine learning, the idea of taking advantage of useful traits across problem domains towards enhanced learning performance has received significant interest under the term of transfer learning (TL) in recent years [9], [10].”
BackgroundInfluentialAdvances in Neural Information Processing Systems 19
(2007) · The MIT Press eBooks · doi:10.52202/085713 · Cited by 15,539
Hearst, M. A., Dumais, S. T., Osuna, E., Platt, J., & Scholkopf, B. (1998) · IEEE Intelligent Systems and their Applications · doi:10.1109/5254.708428 · Cited by 7,243
Weiss, K., Khoshgoftaar, T. M., & Wang, D. (2016) · Journal of Big Data · doi:10.1186/s40537-016-0043-6 · Cited by 6,260
How transferable are features in deep neural networks?
Yosinski, J., Clune, J., Bengio, Y., & Lipson, H. (2014) · arXiv · doi:10.48550/arxiv.1411.1792 · Cited by 6,061 · cited 1×
“On the other hand, the transfer of knowledge, such as neural architectures [84], deep features [85], and internal representations [86], across deep learning models can often improve the deep learning performance.”
BackgroundA Survey on Evolutionary Computation Approaches to Feature Selection
Xue, B., Zhang, M., Browne, W. N., & Yao, X. (2016) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2015.2504420 · Cited by 1,841
Evolutionary Optimization in Uncertain Environments—A Survey
Jin, Y., & Branke, J. (2005) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2005.846356 · Cited by 1,572
Predicting breast cancer survivability: a comparison of three data mining methods
Delen, D., Walker, G., & Kadam, A. (2005) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2004.07.002 · Cited by 1,218
Multifactorial Evolution: Toward Evolutionary Multitasking
Gupta, A., Ong, Y.-S., & Feng, L. (2016) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2015.2458037 · Cited by 993
Self-citationQuality management on Amazon Mechanical Turk
Ipeirotis, P. G., Provost, F., & Wang, J. (2010) · Proceedings of the ACM SIGKDD Workshop on Human Computation · doi:10.1145/1837885.1837906 · Cited by 973
Transfer Learning for Visual Categorization: A Survey
Shao, L., Zhu, F., & Li, X. (2015) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2014.2330900 · Cited by 895 · cited 1×
“The knowledge learned and transferred across tasks can come from diverse representations [29], e.”
BackgroundMultiobjective Deep Belief Networks Ensemble for Remaining Useful Life Estimation in Prognostics
Zhang, C., Lim, P., Qin, A. K., & Tan, K. C. (2017) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2016.2582798 · Cited by 870
Self-citationAutomatically Designing CNN Architectures Using the Genetic Algorithm for Image Classification
Sun, Y., Xue, B., Zhang, M., Yen, G. G., & Lv, J. (2020) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2020.2983860 · Cited by 870
Many-Objective Evolutionary Algorithms: A Survey
Li, B., Li, J., Tang, K., & Yao, X. (2015) · ACM Computing Surveys · doi:10.1145/2792984 · Cited by 815
Evolving Deep Convolutional Neural Networks for Image Classification
Sun, Y., Xue, B., Zhang, M., & Yen, G. G. (2020) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2019.2916183 · Cited by 775
Cooperatively Coevolving Particle Swarms for Large Scale Optimization
Li, X., & Yao, X. (2012) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2011.2112662 · Cited by 745
Cooperative Co-Evolution With Differential Grouping for Large Scale Optimization
Omidvar, M. N., Li, X., Mei, Y., & Yao, X. (2014) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2013.2281543 · Cited by 744
A Model of Inductive Bias Learning
Baxter, J. (2000) · Cited by 730
Transfer Learning in Natural Language Processing
Ruder, S., Peters, M. E., Swayamdipta, S., & Wolf, T. (2019) · Proceedings of the 2019 Conference of the North · doi:10.18653/v1/n19-5004 · Cited by 587
A model of inductive bias learning
Baxter, J. (2000) · Journal of Artificial Intelligence Research · doi:10.1613/jair.731 · Cited by 582 · cited 1×
“Although there are some theoretical analyses of knowledge transfer between classification tasks [93], [94], such analyses do not directly apply to EAs.”
BackgroundAutomatic Speech Recognition: A Deep Learning Approach
Yu, D., & Deng, L. (2015) · Signals and Communication Technology · doi:10.1007/978-1-4471-5779-3 · Cited by 474
Multiobjective Multifactorial Optimization in Evolutionary Multitasking
Gupta, A., Ong, Y.-S., Feng, L., & Tan, K. C. (2017) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2016.2554622 · Cited by 462
Self-citationEvolutionary Multitasking via Explicit Autoencoding
Feng, L., Zhou, L., Zhong, J., Gupta, A., Ong, Y.-S., Tan, K.-C., & Qin, A. K. (2019) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2018.2845361 · Cited by 438
Self-citationMultifactorial Evolutionary Algorithm With Online Transfer Parameter Estimation: MFEA-II
Bali, K. K., Ong, Y.-S., Gupta, A., & Tan, P. S. (2020) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2019.2906927 · Cited by 437
Transfer Learning-Based Dynamic Multiobjective Optimization Algorithms
Jiang, M., Huang, Z., Qiu, L., Huang, W., & Yen, G. G. (2018) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2017.2771451 · Cited by 419
Self-citationInsights on Transfer Optimization: Because Experience is the Best Teacher
Gupta, A., Ong, Y.-S., & Feng, L. (2018) · IEEE Transactions on Emerging Topics in Computational Intelligence · doi:10.1109/tetci.2017.2769104 · Cited by 378
Self-citationMachine Learning: An Algorithmic Perspective
Marsland, S. (2014) · Chapman & Hall/CRC eBooks · doi:10.1201/b17476 · Cited by 353
A Level-Based Learning Swarm Optimizer for Large-Scale Optimization
Yang, Q., Chen, W.-N., Deng, J. D., Li, Y., Gu, T., & Zhang, J. (2018) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2017.2743016 · Cited by 326
Linear Programming-1: Introduction.
Dave, U., Dantzig, G. B., & Thapa, M. N. (1998) · The Journal of the Operational Research Society · doi:10.2307/3010109 · Cited by 324
Rich Vehicle Routing Problem: Survey
Caceres-Cruz, J., Arias, P., Guimarans, D., Riera, D., & Juan, A. A. (2015) · ACM Computing Surveys · doi:10.1145/2666003 · Cited by 280
Evolutionary algorithms and gradient search: similarities and differences
Salomon, R. (1998) · IEEE Transactions on Evolutionary Computation · doi:10.1109/4235.728207 · Cited by 278
Generalized Multitasking for Evolutionary Optimization of Expensive Problems
Ding, J., Yang, C., Jin, Y., & Chai, T. (2019) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2017.2785351 · Cited by 277
A Competitive Divide-and-Conquer Algorithm for Unconstrained Large-Scale Black-Box Optimization
Mei, Y., Omidvar, M. N., Li, X., & Yao, X. (2016) · ACM Transactions on Mathematical Software · doi:10.1145/2791291 · Cited by 249
Knee Point-Based Imbalanced Transfer Learning for Dynamic Multiobjective Optimization
Jiang, M., Wang, Z., Hong, H., & Yen, G. G. (2021) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2020.3004027 · Cited by 237
Self-citationMucherino, A., Papajorgji, P. J., & Pardalos, P. M. (2009) · Springer optimization and its applications · doi:10.1007/978-0-387-88615-2_6 · Cited by 219
Feng, L., Huang, Y., Zhou, L., Zhong, J., Gupta, A., Tang, K., & Tan, K. C. (2021) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2019.2962865 · Cited by 217
Self-citationCognizant Multitasking in Multiobjective Multifactorial Evolution: MO-MFEA-II
Bali, K. K., Gupta, A., Ong, Y.-S., & Tan, P. S. (2021) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2020.2981733 · Cited by 198
A Fast Dynamic Evolutionary Multiobjective Algorithm via Manifold Transfer Learning
Jiang, M., Wang, Z., Qiu, L., Guo, S., Gao, X., & Tan, K. C. (2021) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2020.2989465 · Cited by 195
Self-citationKnowledge Incorporation in Evolutionary Computation
Jin, Y. (2005) · Studies in fuzziness and soft computing · doi:10.1007/978-3-540-44511-1 · Cited by 193
Evolutionary Multitasking With Dynamic Resource Allocating Strategy
Gong, M., Tang, Z., Li, H., & Zhang, J. (2019) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2019.2893614 · Cited by 177
Linearized domain adaptation in evolutionary multitasking
Bali, K. K., Gupta, A., Feng, L., Ong, Y. S., & Siew, T. P. (2017) · 2017 IEEE Congress on Evolutionary Computation (CEC) · doi:10.1109/cec.2017.7969454 · Cited by 168
Self-citationLearning With Case-Injected Genetic Algorithms
Louis, S. J., & McDonnell, J. R. (2004) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2004.823466 · Cited by 166
Memetic Search With Interdomain Learning: A Realization Between CVRP and CARP
Feng, L., Ong, Y.-S., Lim, M., & Tsang, I. W.-H. (2015) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2014.2362558 · Cited by 164
Self-citationMultifactorial Genetic Programming for Symbolic Regression Problems
Zhong, J., Feng, L., Cai, W., & Ong, Y.-S. (2020) · IEEE Transactions on Systems, Man, and Cybernetics: Systems · doi:10.1109/tsmc.2018.2853719 · Cited by 163
Self-citationAn Effective Knowledge Transfer Approach for Multiobjective Multitasking Optimization
Lin, J., Liu, H., Tan, K. C., & Gu, F. (2020) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2020.2969025 · Cited by 163
Self-citationAutoencoding Evolutionary Search With Learning Across Heterogeneous Problems
Feng, L., Ong, Y.-S., Jiang, S., & Gupta, A. (2017) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2017.2682274 · Cited by 159
Self-citationMin, A. T. W., Ong, Y.-S., Gupta, A., & Goh, C.-K. (2017) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2017.2783441 · Cited by 154
Curbing Negative Influences Online for Seamless Transfer Evolutionary Optimization
Da, B., Gupta, A., & Ong, Y.-S. (2018) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2018.2864345 · Cited by 148
On handling negative transfer and imbalanced distributions in multiple source transfer learning
Ge, L., Gao, J., Ngo, H. Q., Li, K., & Zhang, A. (2014) · Statistical Analysis and Data Mining The ASA Data Science Journal · doi:10.1002/sam.11217 · Cited by 144
Transfer Learning for Speech Recognition on a Budget
Kunze, J., Kirsch, L., Kurenkov, I., Krug, A., Johannsmeier, J., & Stober, S. (2017) · Proceedings of the 2nd Workshop on Representation Learning for NLP · doi:10.18653/v1/w17-2620 · Cited by 141
Cross-Domain Reuse of Extracted Knowledge in Genetic Programming for Image Classification
Iqbal, M., Xue, B., Al-Sahaf, H., & Zhang, M. (2017) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2017.2657556 · Cited by 128
Feng, L., Ong, Y.-S., Tan, A., & Tsang, I. W.-H. (2015) · Memetic Computing · doi:10.1007/s12293-015-0166-x · Cited by 125
Self-citationLiang, Z., Liang, W., Wang, Z.-Q., Ma, X., Лиу, Л., & Zhu, Z. (2021) · IEEE Transactions on Systems Man and Cybernetics Systems · doi:10.1109/tsmc.2021.3096220 · Cited by 123
Structure Learning for Deep Neural Networks Based on Multiobjective Optimization
Liu, J., Gong, M., Miao, Q., Wang, X., & Li, H. (2017) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2017.2695223 · Cited by 116
Evolutionary many-tasking based on biocoenosis through symbiosis: A framework and benchmark problems
Liaw, R.-T., & Ting, C.-K. (2017) · IEEE Congress on Evolutionary Computation (CEC) · doi:10.1109/cec.2017.7969579 · Cited by 104
Deep Learning for Recommender Systems
Karatzoglou, A., & Hidasi, B. (2017) · ACM Conference on Recommender Systems (RecSys) · doi:10.1145/3109859.3109933 · Cited by 104
A notion of task relatedness yielding provable multiple-task learning guarantees
Ben-David, S., & Schuller, R. (2008) · Machine Learning · doi:10.1007/s10994-007-5043-5 · Cited by 103
Multitasking Multiobjective Evolutionary Operational Indices Optimization of Beneficiation Processes
Yang, C., Ding, J., Jin, Y., Wang, C., & Chai, T. (2018) · IEEE Transactions on Automation Science and Engineering · doi:10.1109/tase.2018.2865593 · Cited by 98
Yang, C., Ding, J., Jin, Y., & Chai, T. (2019) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2019.2925959 · Cited by 96
Evolutionary Multitasking Sparse Reconstruction: Framework and Case Study
Li, H., Ong, Y.-S., Gong, M., & Wang, Z. (2018) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2018.2881955 · Cited by 91
Online linear regression and its application to model-based reinforcement learning
Strehl, A. L., & Littman, M. L. (2007) · Cited by 87
A Group-based Approach to Improve Multifactorial Evolutionary Algorithm
Tang, J., Chen, Y., Deng, Z., Xiang, Y., & Joy, C. P. (2018) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2018/538 · Cited by 83
Quality diversity for multi-task optimization
Mouret, J.-B., & Maguire, G. (2020) · Genetic and Evolutionary Computation Conference (GECCO) · doi:10.1145/3377930.3390203 · Cited by 76
Knowledge Transfer in Deep Block-Modular Neural Networks
Terekhov, A. V., Montone, G., & O’Regan, J. K. (2015) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-22979-9_27 · Cited by 67
Landscape synergy in evolutionary multitasking
Gupta, A., Ong, Y.-S., Da, B., Feng, L., & Handoko, S. D. (2016) · IEEE Congress on Evolutionary Computation (CEC) · doi:10.1109/cec.2016.7744178 · Cited by 60
Self-citationDa, B., Gupta, A., Ong, Y.-S., & Feng, L. (2016) · IEEE Congress on Evolutionary Computation (CEC) · doi:10.1109/cec.2016.7743992 · Cited by 57
Self-citationKNOWLEDGE TRANSFER IN DEEP CONVOLUTIONAL NEURAL NETS
GUTSTEIN, S., FUENTES, O., & FREUDENTHAL, E. (2008) · International Journal on Artificial Intelligence Tools · doi:10.1142/s0218213008004059 · Cited by 44
When and How to Transfer Knowledge in Dynamic Multi-objective Optimization
Ruan, G., Minku, L. L., Menzel, S., Sendhoff, B., & Yao, X. (2019) · IEEE Symposium Series on Computational Intelligence (SSCI) · doi:10.1109/ssci44817.2019.9002815 · Cited by 35
Generalisation and domain adaptation in GP with gradient descent for symbolic regression
Chen, Q., Xue, B., & Zhang, M. (2015) · IEEE Congress on Evolutionary Computation (CEC) · doi:10.1109/cec.2015.7257017 · Cited by 34
Transfer Learning with Label NoisePreprint
Yu, X., Liu, T., Gong, M., Zhang, K., Batmanghelich, K. N., & Tao, D. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1707.09724 · Cited by 30
Transfer learning for vision-based tactile sensing
Sferrazza, C., & D’Andrea, R. (2019) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros40897.2019.8967571 · Cited by 28
Memetic Computation: The Mainspring of Knowledge Transfer in a Data-Driven Optimization Era
Gupta, A., & Ong, Y.-S. (2018) · Adaptation, learning, and optimization · doi:10.1007/978-3-030-02729-2 · Cited by 26
Simultaneously Evolving Deep Reinforcement Learning Models using Multifactorial optimization
Martinez, A. D., Osaba, E., Ser, J. D., & Herrera, F. (2020) · IEEE Congress on Evolutionary Computation (CEC) · doi:10.1109/cec48606.2020.9185667 · Cited by 15
Chaabani, A., & Saïd, L. B. (2018) · Applied Intelligence · doi:10.1007/s10489-018-1309-9 · Cited by 12
Cited by
Rajwar, K., Deep, K., & Das, S. (2023) · Artificial Intelligence Review · doi:10.1007/s10462-023-10470-y · Cited by 687
A survey on evolutionary computation for complex continuous optimization
Zhan, Z.-H., Shi, L., Tan, K. C., & Zhang, J. (2022) · Artificial Intelligence Review · doi:10.1007/s10462-021-10042-y · Cited by 416
Self-citation
Metadata
- Authors
- Tan, K. C., Feng, L., & Jiang, M.
- Venue
- IEEE Computational Intelligence Magazine
- Published
- 2021-02
- Volume
- 16
- Issue
- 1
- Pages
- 22-33
- ISSN
- 1556-603X (ISSN-L)
- 1556-6048
- OpenAlex
- W3120732119
- Cited by
- 315
- References
- 77
- FWCI
- 18.26
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.