The DOI matches its Crossref record; 131 of the 131 references it cites were found in a registry or an index.
Recent Advances in Bayesian Optimization
Open accessAbstract
Bayesian optimization has emerged at the forefront of expensive black-box optimization due to its data efficiency. Recent years have witnessed a proliferation of studies on the development of new Bayesian optimization algorithms and their applications. Hence, this article attempts to provide a comprehensive and updated survey of recent advances in Bayesian optimization that are mainly based on Gaussian processes and identify challenging open problems. We categorize the existing work on Bayesian optimization into nine main groups according to the motivations and focus of the proposed algorithms. For each category, we present the main advances with respect to the construction of surrogate models and adaptation of the acquisition functions. Finally, we discuss the open questions and suggest promising future research directions, in particular with regard to heterogeneity, privacy preservation, and fairness in distributed and federated optimization systems.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
MOEA/D: A Multiobjective Evolutionary Algorithm Based on Decomposition
Zhang, Q., & Li, H. (2007) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2007.892759 · Cited by 10,069
Multiobjective evolutionary algorithms: a comparative case study and the strength Pareto approach
Zitzler, E., & Thiele, L. (1999) · IEEE Transactions on Evolutionary Computation · doi:10.1109/4235.797969 · Cited by 8,798
Efficient Global Optimization of Expensive Black-Box Functions
Jones, D. R., Schonlau, M., & Welch, W. J. (1998) · Journal of Global Optimization · doi:10.1023/a:1008306431147 · Cited by 8,070
Design and Analysis of Computer Experiments
Sacks, J., Welch, W. J., Mitchell, T. J., & Wynn, H. P. (1989) · Statistical Science · doi:10.1214/ss/1177012413 · Cited by 6,919
Practical Bayesian Optimization of Machine Learning Algorithms
Snoek, J., Larochelle, H., & Adams, R. P. (2012) · arXiv · doi:10.48550/arxiv.1206.2944 · Cited by 6,691
Taking the Human Out of the Loop: A Review of Bayesian Optimization
Shahriari, B., Swersky, K., Wang, Z., Adams, R. P., & de Freitas, N. (2016) · Proceedings of the IEEE · doi:10.1109/jproc.2015.2494218 · Cited by 6,049
Proceedings of the 21st International Conference on Neural Information Processing Systems
Koller, D., Schuurmans, D., Bengio, Y., & Bottou, L. (2008) · Cited by 4,461
Performance assessment of multiobjective optimizers: an analysis and review
Zitzler, E., Thiele, L., Laumanns, M., Fonseca, C. M., & da Fonseca, V. G. (2003) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2003.810758 · Cited by 4,330
Automatic Chemical Design Using a Data-Driven Continuous Representation of Molecules
Gómez-Bombarelli, R., Wei, J. N., Duvenaud, D., Hernández-Lobato, J. M., Sánchez-Lengeling, B., Sheberla, D., Aguilera-Iparraguirre, J., Hirzel, T. D., Adams, R. P., & Aspuru-Guzik, A. (2018) · ACS Central Science · doi:10.1021/acscentsci.7b00572 · Cited by 3,106
Sequential Model-Based Optimization for General Algorithm Configuration
Hutter, F., Hoos, H. H., & Leyton-Brown, K. (2011) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-25566-3_40 · Cited by 2,469
Multiobjective evolutionary algorithms: A survey of the state of the art
Zhou, A., Qu, B.-Y., Li, H., Zhao, S.-Z., Suganthan, P. N., & Zhang, Q. (2011) · Swarm and Evolutionary Computation · doi:10.1016/j.swevo.2011.03.001 · Cited by 2,255
Brochu, E., Cora, V. M., & de Freitas, N. (2010) · arXiv (Cornell University) · doi:10.48550/arxiv.1012.2599 · Cited by 2,011
Information-Theoretic Regret Bounds for Gaussian Process Optimization in the Bandit Setting
Srinivas, N., Krause, A., Kakade, S. M., & Seeger, M. W. (2012) · IEEE Transactions on Information Theory · doi:10.1109/tit.2011.2182033 · Cited by 1,850
A Reference Vector Guided Evolutionary Algorithm for Many-Objective Optimization
Cheng, R., Jin, Y., Olhofer, M., & Sendhoff, B. (2016) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2016.2519378 · Cited by 1,760
Self-citationCressie, N. (1990) · Mathematical Geology · doi:10.1007/bf00889887 · Cited by 1,728
Predicting the output from a complex computer code when fast approximations are available
Kennedy, M. (2000) · Biometrika · doi:10.1093/biomet/87.1.1 · Cited by 1,605
Kriging Metamodeling in Simulation: A Review
Kleijnen, J. P. C. (2007) · European Journal of Operational Research · doi:10.1016/j.ejor.2007.10.013 · Cited by 1,355
Proceedings of the 26th International Conference on Neural Information Processing Systems
Burges, C. J. C., Bottou, L., Welling, M., Zoubin Ghahramani, A., & Weinberger, K. Q. (2013) · Cited by 1,323
Knowles, J. (2006) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2005.851274 · Cited by 1,254
A New Method of Locating the Maximum Point of an Arbitrary Multipeak Curve in the Presence of Noise
Kushner, H. J. (1964) · Journal of Basic Engineering · doi:10.1115/1.3653121 · Cited by 1,082
Practical Variational Inference for Neural Networks
Graves, A. (2011) · Cited by 1,078
Multi-task Gaussian Process Prediction
Bonilla, E. V., Chai, K. M. A., & Williams, C. K. I. (2007) · Cited by 923
When Gaussian Process Meets Big Data: A Review of Scalable GPs
Liu, H., Ong, Y.-S., Shen, X., & Cai, J. (2020) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2019.2957109 · Cited by 878
Frazier, P. I. (2018) · Recent Advances in Optimization and Modeling of Contemporary Problems · doi:10.1287/educ.2018.0188 · Cited by 826
Many-Objective Evolutionary Algorithms: A Survey
Li, B., Li, J., Tang, K., & Yao, X. (2015) · ACM Computing Surveys · doi:10.1145/2792984 · Cited by 815
Single- and multiobjective evolutionary optimization assisted by Gaussian random field metamodels
Emmerich, M. T. M., Giannakoglou, K. C., & Naujoks, B. (2006) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2005.859463 · Cited by 759
Expensive Multiobjective Optimization by MOEA/D With Gaussian Process Model
Zhang, Q., Liu, W., Tsang, E., & Virginas, B. (2010) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2009.2033671 · Cited by 746
Global Optimization of Stochastic Black-Box Systems via Sequential Kriging Meta-Models
Huang, D., Allen, T. T., Notz, W. I., & Zeng, N. (2006) · Journal of Global Optimization · doi:10.1007/s10898-005-2454-3 · Cited by 625
Chugh, T., Jin, Y., Miettinen, K., Hakanen, J., & Sindhya, K. (2018) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2016.2622301 · Cited by 625
Self-citationProceedings of the 1987 International Conference on Neural Information Processing Systems
Anderson, D. (1987) · Cited by 622
Google Vizier: A Service for Black-Box Optimization
Golovin, D., Solnik, B., Moitra, S., Kochanski, G., Karro, J., & Sculley, D. (2017) · Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/3097983.3098043 · Cited by 571
Matrix formulation of co-kriging
Myers, D. E. (1982) · Journal of the International Association for Mathematical Geology · doi:10.1007/bf01032887 · Cited by 512
Spatial modelling using a new class of nonstationary covariance functions
Paciorek, C. J., & Schervish, M. J. (2006) · Environmetrics · doi:10.1002/env.785 · Cited by 487
Nonlinear information fusion algorithms for data-efficient multi-fidelity modelling
Perdikaris, P., Raissi, M., Damianou, A., Lawrence, N. D., & Karniadakis, G. E. (2017) · Proceedings of the Royal Society A: Mathematical, Physical and Engineering Sciences · doi:10.1098/rspa.2016.0751 · Cited by 448
A Knowledge-Gradient Policy for Sequential Information Collection
Frazier, P. I., Powell, W. B., & Dayanik, S. (2008) · SIAM Journal on Control and Optimization · doi:10.1137/070693424 · Cited by 447
Entropy search for information-efficient global optimization
Hennig, P., & Schuler, C. J. (2012) · Journal of Machine Learning Research · doi:10.5555/2188385.2343701 · Cited by 443
Global versus local search in constrained optimization of computer models
Schonlau, M., Welch, W. J., & Jones, D. R. (1998) · Institute of Mathematical Statistics Lecture Notes - Monograph Series · doi:10.1214/lnms/1215456182 · Cited by 435
Sequential kriging optimization using multiple-fidelity evaluations
Huang, D., Allen, T. T., Notz, W. I., & Miller, R. A. (2006) · Structural and Multidisciplinary Optimization · doi:10.1007/s00158-005-0587-0 · Cited by 414
Predictive Entropy Search for Efficient Global Optimization of Black-box Functions
Hernández-Lobato, J. M., Hoffman, M. W., & Ghahramani, Z. (2014) · arXiv · doi:10.48550/arxiv.1406.2541 · Cited by 407
On Bayesian Methods for Seeking the Extremum
Močkus, J. (1975) · Optimization Techniques IFIP Technical Conference · doi:10.1007/978-3-662-38527-2_55 · Cited by 402
Kriging Is Well-Suited to Parallelize Optimization
Ginsbourger, D., Le Riche, R., & Carraro, L. (2010) · Adaptation Learning and Optimization · doi:10.1007/978-3-642-10701-6_6 · Cited by 396
Initializing Bayesian Hyperparameter Optimization via Meta-Learning
Feurer, M., Springenberg, J., & Hutter, F. (2015) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v29i1.9354 · Cited by 390
RECURSIVE CO-KRIGING MODEL FOR DESIGN OF COMPUTER EXPERIMENTS WITH MULTIPLE LEVELS OF FIDELITY
Le Gratiet, L., & Garnier, J. (2014) · International Journal for Uncertainty Quantification · doi:10.1615/int.j.uncertaintyquantification.2014006914 · Cited by 388
Infinite Mixtures of Gaussian Process Experts
Rasmussen, C. E., & Ghahramani, Z. (2001) · Cited by 377
Sasena, M. J. (2002) · Cited by 350
Bayesian Hierarchical Modeling for Integrating Low-Accuracy and High-Accuracy Experiments
Qian, P. Z. G., & Wu, C. F. J. (2008) · Technometrics · doi:10.1198/004017008000000082 · Cited by 336
A benchmark of kriging-based infill criteria for noisy optimization
Picheny, V., Wagner, T., & Ginsbourger, D. (2013) · Structural and Multidisciplinary Optimization · doi:10.1007/s00158-013-0919-4 · Cited by 325
Scalable Global Optimization via Local Bayesian OptimizationPreprint
Eriksson, D., Pearce, M., Gardner, J. R., Turner, R., & Poloczek, M. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1910.01739 · Cited by 318
Statistical Improvement Criteria for Use in Multiobjective Design Optimization
Keane, A. J. (2006) · AIAA Journal · doi:10.2514/1.16875 · Cited by 312
Constrained Bayesian Optimization with Noisy Experiments
Letham, B., Karrer, B., Ottoni, G., & Bakshy, E. (2019) · Bayesian Analysis · doi:10.1214/18-ba1110 · Cited by 307
Zhou, A., Jin, Y., Zhang, Q., Sendhoff, B., & Tsang, E. (2006) · 2006 IEEE International Conference on Evolutionary Computation · doi:10.1109/cec.2006.1688406 · Cited by 303
Self-citationBayesian optimization with robust Bayesian neural networks
Springenberg, J. T., Klein, A., Falkner, S., & Hutter, F. (2016) · neural information processing systems · Cited by 300
Remarks on multi-output Gaussian process regression
Liu, H., Cai, J., & Ong, Y.-S. (2018) · Knowledge-Based Systems · doi:10.1016/j.knosys.2017.12.034 · Cited by 294
Garrido-Merchán, E. C., & Hernández-Lobato, D. (2020) · Neurocomputing · doi:10.1016/j.neucom.2019.11.004 · Cited by 291
Kriging for interpolation in random simulation
van Beers, W. C. M., & Kleijnen, J. P. C. (2003) · Journal of the Operational Research Society · doi:10.1057/palgrave.jors.2601492 · Cited by 286
Regression with Input-dependent Noise: A Gaussian Process Treatment
Goldberg, P. W., Williams, C. K. I., & Bishop, C. (1997) · Aston Publications Explorer (Aston University) · Cited by 275
Bradford, E., Schweidtmann, A. M., & Lapkin, A. (2018) · Journal of Global Optimization · doi:10.1007/s10898-018-0609-2 · Cited by 266
Neural Architecture Search with Bayesian Optimisation and Optimal Transport
Kandasamy, K., Neiswanger, W., Schneider, J., Póczos, B., & Xing, E. P. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1802.07191 · Cited by 259
Couckuyt, I., Deschrijver, D., & Dhaene, T. (2014) · Journal of Global Optimization · doi:10.1007/s10898-013-0118-2 · Cited by 254
Guo, D., Jin, Y., Ding, J., & Chai, T. (2019) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2018.2794503 · Cited by 248
Self-citationExpected improvement for expensive optimization: a review
Zhan, D., & Xing, H. (2020) · Journal of Global Optimization · doi:10.1007/s10898-020-00923-x · Cited by 242
Design and Analysis of "Noisy" Computer Experiments
Forrester, A. I. J., Keane, A. J., & Bressloff, N. W. (2006) · AIAA Journal · doi:10.2514/1.20068 · Cited by 233
Ponweiser, W., Wagner, T., Biermann, D., & Vincze, M. (2008) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-87700-4_78 · Cited by 224
Computationally Efficient Convolved Multiple Output Gaussian Processes
Álvarez, M. A., & Lawrence, N. D. (2009) · Apollo (University of Cambridge) · doi:10.17863/cam.48485 · Cited by 214
Scott, W., Frazier, P., & Powell, W. (2011) · SIAM Journal on Optimization · doi:10.1137/100801275 · Cited by 209
Gaussian Process Training with Input Noise
McHutchon, A., & Rasmussen, C. E. (2011) · Cited by 205
Hypervolume-based expected improvement: Monotonicity properties and exact computation
Emmerich, M. T. M., Deutz, A. H., & Klinkenberg, J. W. (2011) · 2011 IEEE Congress of Evolutionary Computation (CEC) · doi:10.1109/cec.2011.5949880 · Cited by 200
Guo, D., Wang, X., Gao, K., Jin, Y., Ding, J., & Chai, T. (2022) · IEEE Transactions on Systems, Man, and Cybernetics: Systems · doi:10.1109/tsmc.2020.3044418 · Cited by 196
Self-citationParallel Bayesian Global Optimization of Expensive Functions
Wang, J., Clark, S., Liu, E., & Frazier, P. I. (2020) · Operations Research · doi:10.1287/opre.2019.1966 · Cited by 188
Quantile-Based Optimization of Noisy Computer Experiments With Tunable Precision
Picheny, V., Ginsbourger, D., Richet, Y., & Caplin, G. (2013) · Technometrics · doi:10.1080/00401706.2012.707580 · Cited by 184
Duvenaud, D., Nickisch, H., & Rasmussen, C. E. (2011) · arXiv (Cornell University) · doi:10.48550/arxiv.1112.4394 · Cited by 183
A Survey on High-dimensional Gaussian Process Modeling with Application to Bayesian Optimization
Binois, M., & Wycoff, N. (2022) · ACM Transactions on Evolutionary Learning and Optimization · doi:10.1145/3545611 · Cited by 180
Lv, Z., Wang, L., Han, Z., Zhao, J., & Wang, W. (2019) · IEEE/CAA Journal of Automatica Sinica · doi:10.1109/jas.2019.1911450 · Cited by 179
High-dimensional Bayesian optimization using low-dimensional feature spaces
Moriconi, R., Deisenroth, M. P., & Sesh Kumar, K. S. (2020) · Machine Learning · doi:10.1007/s10994-020-05899-z · Cited by 175
Scalable Gaussian process-based transfer surrogates for hyperparameter optimization
Wistuba, M., Schilling, N., & Schmidt-Thieme, L. (2017) · Machine Learning · doi:10.1007/s10994-017-5684-y · Cited by 174
Multi-Objective Bayesian Global Optimization using expected hypervolume improvement gradient
Yang, K., Emmerich, M., Deutz, A. H., & Bäck, T. (2018) · Swarm and Evolutionary Computation · doi:10.1016/j.swevo.2018.10.007 · Cited by 174
An adaptive Bayesian approach to surrogate-assisted evolutionary multi-objective optimization
Wang, X., Jin, Y., Schmitt, S., & Olhofer, M. (2020) · Information Sciences · doi:10.1016/j.ins.2020.01.048 · Cited by 165
Self-citationPredictive Entropy Search for Efficient Global Optimization of Black-box FunctionsPreprint
Hernández-Lobato, J. M., Hoffman, M. W., & Zoubin Ghahramani, A. (2014) · arXiv (Cornell University) · Cited by 162
Chevalier, C., Bect, J., Ginsbourger, D., Vázquez, E., Picheny, V., & Richet, Y. (2013) · Technometrics · doi:10.1080/00401706.2013.860918 · Cited by 160
Min, A. T. W., Ong, Y.-S., Gupta, A., & Goh, C.-K. (2017) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2017.2783441 · Cited by 154
Parallel Gaussian process optimization with upper confidence bound and pure explorationPreprint
Contal, E., Buffoni, D., Robicquet, R., & Vayatis, N. (2013) · Cited by 151
The Parallel Knowledge Gradient Method for Batch Bayesian OptimizationPreprint
Wu, J., & Frazier, P. I. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1606.04414 · Cited by 148
Optimization Under Unknown Constraints*
Gramacy, R. B., & Lee, H. K. H. (2011) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780199694587.003.0008 · Cited by 143
Zhang, S., Yang, F., Yan, C., Zhou, D., & Zeng, X. (2021) · IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems · doi:10.1109/tcad.2021.3054811 · Cited by 141
Modeling an Augmented Lagrangian for Blackbox Constrained Optimization
Gramacy, R. B., Gray, G. A., Digabel, S. L., Lee, H. K. H., Ranjan, P., Wells, G. N., & Wild, S. M. (2015) · Technometrics · doi:10.1080/00401706.2015.1014065 · Cited by 127
On Expected-Improvement Criteria for Model-based Multi-objective Optimization
Wagner, T., Emmerich, M., Deutz, A. H., & Ponweiser, W. (2010) · Springer eBooks · doi:10.1007/978-3-642-15844-5_72 · Cited by 126
A Survey of Evolutionary Continuous Dynamic Optimization Over Two Decades—Part A
Yazdani, D., Cheng, R., Yazdani, D., Branke, J., Jin, Y., & Yao, X. (2021) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2021.3060014 · Cited by 126
Self-citationMarco, A., Berkenkamp, F., Hennig, P., Schoellig, A. P., Krause, A., Schaal, S., & Trimpe, S. (2017) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2017.7989186 · Cited by 120
A General Framework for Constrained Bayesian Optimization using Information-based SearchPreprint
Hernández-Lobato, J. M., Gelbart, M. A., Adams, R. P., Hoffman, M. W., & Zoubin Ghahramani, A. (2015) · arXiv (Cornell University) · doi:10.17863/cam.6477 · Cited by 118
Efficient Global Optimization (EGO) for Multi-Objective Problem and Data Mining
Jeong, S., & Obayashi, S. (2005) · IEEE Congress on Evolutionary Computation (CEC) · doi:10.1109/cec.2005.1554959 · Cited by 104
SkData: Data Sets and Algorithm Evaluation Protocols in Python
Bergstra, J., Pinto, N., & Cox, D. (2013) · Proceedings of the Python in Science Conferences · doi:10.25080/majora-8b375195-004 · Cited by 97
Multiobjective optimization of expensive-to-evaluate deterministic computer simulator models
Svenson, J. D., & Santner, T. J. (2015) · Computational Statistics & Data Analysis · doi:10.1016/j.csda.2015.08.011 · Cited by 94
Efficient high dimensional Bayesian optimization with additivity and quadrature Fourier features
Mutný, M., & Krause, A. (2019) · Repository for Publications and Research Data (ETH Zurich) · doi:10.3929/ethz-b-000309658 · Cited by 91
Proceedings of the 23rd International Conference on Neural Information Processing Systems
Lafferty, J., Williams, C. K., Shawe-Taylor, J. S., Zemel, R. S., & Culotta, A. (2010) · Cited by 86
Parallel Gaussian Process Optimization with Upper Confidence Bound and Pure Exploration
Contal, E., Buffoni, D., Robicquet, A., & Vayatis, N. (2013) · Lecture notes in computer science · doi:10.1007/978-3-642-40988-2_15 · Cited by 85
Jiao, R., Zeng, S., Li, C., Jiang, Y., & Jin, Y. (2018) · Information Sciences · doi:10.1016/j.ins.2018.09.003 · Cited by 82
Self-citationFederated Bayesian Optimization via Thompson SamplingPreprint
Dai, Z., Low, B. K. H., & Jaillet, P. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.10154 · Cited by 77
Uncertainty-Aware Search Framework for Multi-Objective Bayesian Optimization
Belakaria, S., Deshwal, A., Jayakodi, N. K., & Doppa, J. R. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i06.6561 · Cited by 76
A federated data-driven evolutionary algorithm
Xu, J., Jin, Y., Du, W., & Gu, S. (2021) · Knowledge-Based Systems · doi:10.1007/s40747-021-00506-7 · Cited by 75
Self-citationWorst-case global optimization of black-box functions through Kriging and relaxation
Marzat, J., Walter, E., & Piet-Lahanier, H. (2012) · Journal of Global Optimization · doi:10.1007/s10898-012-9899-y · Cited by 74
Multi-fidelity Gaussian Process Bandit Optimisation
Kandasamy, K., Dasarathy, G., Oliva, J. B., Schneider, J., & Póczos, B. (2019) · Journal of Artificial Intelligence Research · doi:10.1613/jair.1.11288 · Cited by 73
Batch Bayesian optimization using multi-scale search
Joy, T. T., Rana, S., Gupta, S., & Venkatesh, S. (2019) · Knowledge-Based Systems · doi:10.1016/j.knosys.2019.06.026 · Cited by 72
Bayesian optimization using deep Gaussian processes with applications to aerospace system design
Hebbal, A., Brevault, L., Balesdent, M., Talbi, E., & Melab, N. (2020) · Optimization and Engineering · doi:10.1007/s11081-020-09517-8 · Cited by 70
Perrone, V., Donini, M., Zafar, M. B., Schmucker, R., Kenthapadi, K., & Archambeau, C. (2021) · Proceedings of the 2021 AAAI/ACM Conference on AI, Ethics, and Society · doi:10.1145/3461702.3462629 · Cited by 66
Efficient Kriging-based robust optimization of unconstrained problems
Rehman, S. U., Langelaar, M., & van Keulen, F. (2014) · Journal of Computational Science · doi:10.1016/j.jocs.2014.04.005 · Cited by 64
A flexible transfer learning framework for Bayesian optimization with convergence guarantee
Joy, T. T., Rana, S., Gupta, S., & Venkatesh, S. (2018) · Expert Systems with Applications · doi:10.1016/j.eswa.2018.08.023 · Cited by 62
Efficient global optimization of constrained mixed variable problems
Pelamatti, J., Brevault, L., Balesdent, M., Talbi, E., & Guérin, Y. (2018) · Journal of Global Optimization · doi:10.1007/s10898-018-0715-1 · Cited by 61
Approaches to robust process identification: A review and tutorial of probabilistic methods
Kodamana, H., Huang, B., Ranjan, R., Zhao, Y., Tan, R., & Sammaknejad, N. (2018) · Journal of Process Control · doi:10.1016/j.jprocont.2018.02.011 · Cited by 60
Bayesian Optimization with a Finite Budget: An Approximate Dynamic Programming Approach
Lam, R., Willcox, K. E., & Wolpert, D. H. (2016) · neural information processing systems · Cited by 59
Unscented Bayesian optimization for safe robot grasping
Nogueira, J., Martínez-Cantín, R., Bernardino, A. J. M., & Jamone, L. (2016) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2016.7759310 · Cited by 58
Combinatorial Bayesian Optimization using the Graph Cartesian Product
Oh, C., Tomczak, J. M., Gavves, E., & Welling, M. (2019) · UvA-DARE (University of Amsterdam) · doi:10.48550/arxiv.1902.00448 · Cited by 58
Januševskis, J., Riche, R. L., Ginsbourger, D., & Girdziušas, R. (2012) · Lecture notes in computer science · doi:10.1007/978-3-642-34413-8_37 · Cited by 57
Deep Gaussian process for multi-objective Bayesian optimization
Hebbal, A., Balesdent, M., Brevault, L., Melab, N., & Talbi, E. (2022) · Optimization and Engineering · doi:10.1007/s11081-022-09753-0 · Cited by 56
Scalable Hyperparameter Optimization with Products of Gaussian Process Experts
Schilling, N., Wistuba, M., & Schmidt-Thieme, L. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-46128-1_3 · Cited by 54
Robust Model-free Reinforcement Learning with Multi-objective Bayesian Optimization
Turchetta, M., Krause, A., & Trimpe, S. (2020) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra40945.2020.9197000 · Cited by 54
Sequential optimization using multi-level cokriging and extended expected improvement criterion
Liu, Y., Chen, S., Wang, F., & Xiong, F. (2018) · Structural and Multidisciplinary Optimization · doi:10.1007/s00158-018-1959-6 · Cited by 52
Scalable Meta-Learning for Bayesian OptimizationPreprint
Feurer, M., Letham, B., & Bakshy, E. (2018) · arXiv (Cornell University) · Cited by 51
Global Sensitivity Analysis for Optimization with Variable Selection
Spagnol, A., Riche, R. L., & da Veiga, S. (2019) · SIAM/ASA Journal on Uncertainty Quantification · doi:10.1137/18m1167978 · Cited by 51
Bayesian Optimization for Categorical and Category-Specific Continuous Inputs
Nguyen, D., Gupta, S., Rana, S., Shilton, A., & Venkatesh, S. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i04.5971 · Cited by 50
Generalizing Transfer Bayesian Optimization to Source-Target Heterogeneity
Min, A. T. W., Gupta, A., & Ong, Y.-S. (2020) · IEEE Transactions on Automation Science and Engineering · doi:10.1109/tase.2020.3017644 · Cited by 38
High Dimensional Bayesian Optimization via Supervised Dimension Reduction
Zhang, M., Li, H., & Su, S. W. (2019) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2019/596 · Cited by 37
Constrained Bayesian Optimization with Max-Value Entropy SearchPreprint
Perrone, V., Shcherbatyi, I., Jenatton, R., Archambeau, C., & Seeger, M. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1910.07003 · Cited by 37
Wang, X., Jin, Y., Schmitt, S., Olhofer, M., & Allmendinger, R. (2021) · Knowledge-Based Systems · doi:10.1016/j.knosys.2021.107190 · Cited by 36
Self-citationGood practices for Bayesian optimization of high dimensional structured spaces
Siivola, E., Paleyes, A., González, J., & Vehtari, A. (2021) · Applied AI Letters · doi:10.1002/ail2.24 · Cited by 34
Differentially Private Federated Bayesian Optimization with Distributed ExplorationPreprint
Dai, Z., Low, B. K. H., & Jaillet, P. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2110.14153 · Cited by 28
Batch Bayesian optimization via adaptive local search
Liu, J., Jiang, C., & Zheng, J. (2020) · Applied Intelligence · doi:10.1007/s10489-020-01790-5 · Cited by 27
HyperSpace: Distributed Bayesian Hyperparameter Optimization
Young, M. T., Hinkle, J. D., Ramanathan, A., & Kannan, R. (2018) · International Symposium on Computer Architecture and High Performance Computing (SBAC-PAD) · doi:10.1109/cahpc.2018.8645954 · Cited by 21
Optimizing Discrete Spaces via Expensive Evaluations: A Learning to Search Framework
Deshwal, A., Belakaria, S., Doppa, J. R., & Fern, A. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i04.5788 · Cited by 20
Black-box combinatorial optimization using models with integer-valued minima
Bliek, L., Verwer, S., & Weerdt, M. M. D. (2020) · Annals of Mathematics and Artificial Intelligence · doi:10.1007/s10472-020-09712-4 · Cited by 18
Mercer Features for Efficient Combinatorial Bayesian Optimization
Deshwal, A., Belakaria, S., & Doppa, J. R. (2021) · AAAI Publications (The Association for the Advancement of Artificial Intelligence (AAAI)) · doi:10.1609/aaai.v35i8.16886 · Cited by 18
Selecting Optimal Source for Transfer Learning in Bayesian Optimisation
Ramachandran, A., Gupta, S., Rana, S., & Venkatesh, S. (2018) · Lecture notes in computer science · doi:10.1007/978-3-319-97304-3_4 · Cited by 11
Metadata
- Authors
- Wang, X., Jin, Y., Schmitt, S., & Olhofer, M.
- Venue
- ACM Computing Surveys
- Published
- 2023-07-13
- Volume
- 55
- Issue
- 13s
- Pages
- 1-36
- ISSN
- 0360-0300 (ISSN-L)
- 1557-7341
- OpenAlex
- W4317883989
- Cited by
- 477
- References
- 131
- Type
- dissertation
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.