The DOI matches its Crossref record; 56 of the 56 references it cites were found in a registry or an index.
Multifactorial Evolutionary Algorithm With Online Transfer Parameter Estimation: MFEA-II
Abstract
Humans rarely tackle every problem from scratch. Given this observation, the motivation for this paper is to improve optimization performance through adaptive knowledge transfer across related problems. The scope for spontaneous transfers under the simultaneous occurrence of multiple problems unveils the benefits of multitasking. Multitask optimization has recently demonstrated competence in solving multiple (related) optimization tasks concurrently. Notably, in the presence of underlying relationships between problems, the transfer of high-quality solutions across them has shown to facilitate superior performance characteristics. However, in the absence of any prior knowledge about the intertask synergies (as is often the case with general black-box optimization), the threat of predominantly negative transfer prevails. Susceptibility to negative intertask interactions can impede the overall convergence behavior. To allay such fears, in this paper, we propose a novel evolutionary computation framework that enables online learning and exploitation of the similarities (and discrepancies) between distinct tasks in multitask settings, for an enhanced optimization process. Our proposal is based on the principled theoretical arguments that seek to minimize the tendency of harmful interactions between tasks, based on a purely data-driven learning of relationships among them. The efficacy of our proposed method is validated experimentally on a series of synthetic benchmarks, as well as a practical study that provides insights into the behavior of the method in the face of several tasks occurring at once.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Pan, S. J., & Yang, Q. (2010) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2009.191 · Cited by 23,387
On Information and Sufficiency
Kullback, S., & Leibler, R. A. (1951) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177729694 · Cited by 20,193
Caruana, R. (1997) · Machine Learning · doi:10.1023/a:1007379606734 · Cited by 6,636
How transferable are features in deep neural networks?
Yosinski, J., Clune, J., Bengio, Y., & Lipson, H. (2014) · arXiv · doi:10.48550/arxiv.1411.1792 · Cited by 6,061
Taking the Human Out of the Loop: A Review of Bayesian Optimization
Shahriari, B., Swersky, K., Wang, Z., Adams, R. P., & de Freitas, N. (2016) · Proceedings of the IEEE · doi:10.1109/jproc.2015.2494218 · Cited by 6,049
A Probabilistic Theory of Pattern Recognition
Devroye, L., Györfi, L., & Lugosi, G. (1996) · Stochastic Modelling and Applied Probability · doi:10.1007/978-1-4612-0711-5 · Cited by 3,274 · cited 2×
“In the limit of large values of N , it follows from the Glivenko-Cantelli theorem [45] that the empirical probability density of the (sub)population P k closely approximates the true underlying distribution p(x).”
BackgroundEvolving Neural Networks through Augmenting Topologies
Stanley, K. O., & Miikkulainen, R. (2002) · Evolutionary Computation · doi:10.1162/106365602320169811 · Cited by 3,258
Learning and Transferring Mid-level Image Representations Using Convolutional Neural Networks
Oquab, M., Bottou, L., Laptev, I., & Sivic, J. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.222 · Cited by 3,150 · cited 1×
“It is worth noting that conceptually similar modes of transfer are often sought in distinct domains, such as genetic programming and deep learning, where learned features (in the form of genetic programming subtrees or multiple layers of feature detectors) are reused across models trained on related datasets [5], [28]…”
BackgroundSimulated Binary Crossover for Continuous Search Space.
Deb, K., & Agrawal, R. B. (1995) · Complex Systems · Cited by 2,976
Estimation of Distribution Algorithms: A New Tool for Evolutionary Computation
Larraanaga, P., & Lozano, J. A. (2001) · Kluwer Academic Publishers eBooks · Cited by 1,914
The irace package: Iterated racing for automatic algorithm configuration
López-Ibáñez, M., Dubois-Lacoste, J., Pérez Cáceres, L., Birattari, M., & Stützle, T. (2016) · Operations Research Perspectives · doi:10.1016/j.orp.2016.09.002 · Cited by 1,761
A cooperative coevolutionary approach to function optimization
Potter, M. A., & Jong, K. A. (1994) · Lecture Notes in Computer Science · doi:10.1007/3-540-58484-6_269 · Cited by 1,510
Multi-task Gaussian Process Prediction
Bonilla, E. V., Chai, K. M. A., & Williams, C. K. I. (2007) · Edinburgh Research Explorer (University of Edinburgh) · Cited by 1,378
A combined genetic adaptive search (GeneAS) for engineering design
Deb, K., & Goyal, M. K. (1996) · Cited by 1,229
Evolution Strategies as a Scalable Alternative to Reinforcement Learning
Salimans, T., Ho, J., Chen, X., Sidor, S., & Sutskever, I. (2017) · arXiv · doi:10.48550/arxiv.1703.03864 · Cited by 1,027
Multifactorial Evolution: Toward Evolutionary Multitasking
Gupta, A., Ong, Y.-S., & Feng, L. (2016) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2015.2458037 · Cited by 993
Self-citationThe Theory of Evolution Strategies
Beyer, H.-G. (2001) · Natural Computing Series · doi:10.1007/978-3-662-04378-3 · Cited by 878
Temporal credit assignment in reinforcement learning
Sutton, R. S. (1984) · ScholarWorks@UMassAmherst (University of Massachusetts Amherst) · Cited by 749
Cooperative Co-Evolution With Differential Grouping for Large Scale Optimization
Omidvar, M. N., Li, X., Mei, Y., & Yao, X. (2014) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2013.2281543 · Cited by 744
A Computationally Efficient Evolutionary Algorithm for Real-Parameter Optimization
Deb, K., Anand, A., & Joshi, D. (2002) · Evolutionary Computation · doi:10.1162/106365602760972767 · Cited by 614
(1995) · Cited by 520
Multi-Task Bayesian Optimization
Swersky, K., Snoek, J., & Adams, R. P. (2013) · Digital Access to Scholarship at Harvard (DASH) (Harvard University) · Cited by 502
Multiobjective Multifactorial Optimization in Evolutionary Multitasking
Gupta, A., Ong, Y.-S., Feng, L., & Tan, K. C. (2017) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2016.2554622 · Cited by 462
Self-citationEvolutionary Multitasking via Explicit Autoencoding
Feng, L., Zhou, L., Zhong, J., Gupta, A., Ong, Y.-S., Tan, K.-C., & Qin, A. K. (2019) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2018.2845361 · Cited by 438
Self-citationTransfer Learning-Based Dynamic Multiobjective Optimization Algorithms
Jiang, M., Huang, Z., Qiu, L., Huang, W., & Yen, G. G. (2018) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2017.2771451 · Cited by 419
Insights on Transfer Optimization: Because Experience is the Best Teacher
Gupta, A., Ong, Y.-S., & Feng, L. (2018) · IEEE Transactions on Emerging Topics in Computational Intelligence · doi:10.1109/tetci.2017.2769104 · Cited by 378
Self-citationGlasmachers, T., Wierstra, D., Schaul, T., Schmidhuber, J., & Yi, S. (2008) · Cited by 352
Generalized Multitasking for Evolutionary Optimization of Expensive Problems
Ding, J., Yang, C., Jin, Y., & Chai, T. (2019) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2017.2785351 · Cited by 277
WierstraDaan, SchaulTom, GlasmachersTobias, SUNYi, PetersJan, & SchmidhuberJürgen (2014) · Journal of Machine Learning Research · doi:10.5555/2627435.2638566 · Cited by 261
Evolutionary Multitasking: A Computer Science View of Cognitive Multitasking
Ong, Y.-S., & Gupta, A. (2016) · Cognitive Computation · doi:10.1007/s12559-016-9395-7 · Cited by 250
Self-citationWierstra, D., Schaul, T., Peters, J., & Schmidhuber, J. (2008) · 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence) · doi:10.1109/cec.2008.4631255 · Cited by 246
On the convergence of a class of estimation of distribution algorithms
Zhang, Q., & Muhlenbein, H. (2004) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2003.820663 · Cited by 224
Boosting for Regression Transfer
Pardoe, D., & Stone, P. (2010) · Cited by 214
Exponential natural evolution strategies
Glasmachers, T., Schaul, T., Yi, S., Wierstra, D., & Schmidhuber, J. (2010) · Proceedings of the 12th annual conference on Genetic and evolutionary computation · doi:10.1145/1830483.1830557 · Cited by 198
High dimensions and heavy tails for natural evolution strategies
Schaul, T., Glasmachers, T., & Schmidhuber, J. (2011) · Annual Conference on Genetic and Evolutionary Computation · doi:10.1145/2001576.2001692 · Cited by 193
Evolving neural network controllers for unstable systems
Wieland, A. P. (2002) · IJCNN-91-Seattle International Joint Conference on Neural Networks · doi:10.1109/ijcnn.1991.155416 · Cited by 184
Gaussian mutation and self-adaption for numeric genetic algorithms
Hinterding, R. (2002) · IEEE International Conference on Evolutionary Computation (ICEC) · doi:10.1109/icec.1995.489178 · Cited by 176
Linearized domain adaptation in evolutionary multitasking
Bali, K. K., Gupta, A., Feng, L., Ong, Y. S., & Siew, T. P. (2017) · 2017 IEEE Congress on Evolutionary Computation (CEC) · doi:10.1109/cec.2017.7969454 · Cited by 168
Self-citationAccelerated Neural Evolution through Cooperatively Coevolved Synapses
GomezFaustino, SchmidhuberJürgen, & MiikkulainenRisto (2008) · Journal of Machine Learning Research · doi:10.5555/1390681.1390712 · Cited by 164
Neuroevolution for reinforcement learning using evolution strategies
Igel, C. (2004) · IEEE Congress on Evolutionary Computation (CEC) · doi:10.1109/cec.2003.1299414 · Cited by 147
Curbing Negative Influences Online for Seamless Transfer Evolutionary Optimization
Da, B., Gupta, A., & Ong, Y.-S. (2018) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2018.2864345 · Cited by 143
Self-citationYuan, Y., Ong, Y.-S., Gupta, A., Tan, P. S., & Xu, H. (2016) · IEEE Region 10 Conference (TENCON) · doi:10.1109/tencon.2016.7848632 · Cited by 131
Self-citationFeng, L., Ong, Y.-S., Tan, A., & Tsang, I. W.-H. (2015) · Memetic Computing · doi:10.1007/s12293-015-0166-x · Cited by 125
Self-citationCross-Domain Reuse of Extracted Knowledge in Genetic Programming for Image Classification
Iqbal, M., Xue, B., Al-Sahaf, H., & Zhang, M. (2017) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2017.2657556 · Cited by 122
Parting ways and reallocating resources in evolutionary multitasking
Wen, Y.-W., & Ting, C.-K. (2017) · IEEE Congress on Evolutionary Computation (CEC) · doi:10.1109/cec.2017.7969596 · Cited by 114
Evolutionary many-tasking based on biocoenosis through symbiosis: A framework and benchmark problems
Liaw, R.-T., & Ting, C.-K. (2017) · IEEE Congress on Evolutionary Computation (CEC) · doi:10.1109/cec.2017.7969579 · Cited by 104
A Group-based Approach to Improve Multifactorial Evolutionary Algorithm
Tang, J., Chen, Y., Deng, Z., Xiang, Y., & Joy, C. P. (2018) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2018/538 · Cited by 83
Evolutionary Manytasking Optimization Based on Symbiosis in Biocoenosis
Liaw, R.-T., & Ting, C.-K. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33014295 · Cited by 80
Estimation of Distribution Algorithms
Pelikán, M., Hauschild, M. W., & Lobo, F. G. (2015) · Springer eBooks · doi:10.1007/978-3-662-43505-2_45 · Cited by 78
Smyth, P., & Wolpert, D. H. (1997) · eScholarship (California Digital Library) · Cited by 65
Evolutionary Multi-task Learning for Modular Knowledge Representation in Neural Networks
Chandra, R., Gupta, A., Ong, Y.-S., & Goh, C.-K. (2017) · Neural Processing Letters · doi:10.1007/s11063-017-9718-z · Cited by 51
Self-citationBack to the Roots: Multi-X Evolutionary Computation
Gupta, A., & Ong, Y.-S. (2019) · Cognitive Computation · doi:10.1007/s12559-018-9620-7 · Cited by 45
Self-citationThe Intentional Unintentional Agent: Learning to Solve Many Continuous Control Tasks SimultaneouslyPreprint
Cabi, S., Colmenarejo, S. G., Hoffman, M. W., Denil, M., Wang, Z., & de Freitas, N. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1707.03300 · Cited by 33
Adaptive Memetic Algorithm Based Evolutionary Multi-tasking Single-Objective Optimization
Chen, Q., Ma, X., Sun, Y., & Zhu, Z. (2017) · Lecture notes in computer science · doi:10.1007/978-3-319-68759-9_38 · Cited by 22
Transfer Learning, Soft Distance-Based Bias, and the Hierarchical BOA
Pelikán, M., Hauschild, M. W., & Lanzi, P. L. (2012) · Lecture notes in computer science · doi:10.1007/978-3-642-32937-1_18 · Cited by 20
Efficient Global Optimization with Indefinite Kernels
Zaefferer, M., & Bartz–Beielstein, T. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-45823-6_7 · Cited by 12
Cited by
Evolutionary Transfer Optimization - A New Frontier in Evolutionary Computation Research
Tan, K. C., Feng, L., & Jiang, M. (2021) · IEEE Computational Intelligence Magazine · doi:10.1109/mci.2020.3039066 · Cited by 315
An Evolutionary Multitasking-Based Feature Selection Method for High-Dimensional Classification
Chen, K., Xue, B., Zhang, M., & Zhou, F. (2022) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2020.3042243 · Cited by 263
Dynamic Auxiliary Task-Based Evolutionary Multitasking for Constrained Multiobjective Optimization
Qiao, K., Yu, K., Qu, B., Liang, J., Song, H., Yue, C., Lin, H., & Tan, K. C. (2023) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2022.3175065 · Cited by 253
Metadata
- Authors
- Bali, K. K., Ong, Y.-S., Gupta, A., & Tan, P. S.
- Venue
- IEEE Transactions on Evolutionary Computation
- Published
- 2020-02
- Volume
- 24
- Issue
- 1
- Pages
- 69-83
- ISSN
- 1089-778X (ISSN-L)
- 1941-0026
- OpenAlex
- W2923639984
- Cited by
- 437
- References
- 56
- FWCI
- 20.03
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.