The DOI matches its Crossref record; 95 of the 95 references it cites were found in a registry or an index.
Bayesian Optimization for Adaptive Experimental Design: A Review
Open accessAbstract
Bayesian optimisation is a statistical method that efficiently models and optimises expensive “black-box” functions. This review considers the application of Bayesian optimisation to experimental design, in comparison to existing Design of Experiments (DOE) methods. Solutions are surveyed for a range of core issues in experimental design including: the incorporation of prior knowledge, high dimensional optimisation, constraints, batch evaluation, multiple objectives, multi-fidelity data, and mixed variable types.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Boyd, S., Parikh, N., Chu, E., Peleato, B., & Eckstein, J. (2011) · Foundations and Trends® in Machine Learning · doi:10.1561/2200000016 · Cited by 17,075
Response Surface Methodology: Process and Product Optimization Using Designed Experiments
Gunst, R. F., Myers, R. H., & Montgomery, D. C. (1996) · Technometrics · doi:10.2307/1270613 · Cited by 9,530
On the limited memory BFGS method for large scale optimization
Liu, D. C., & Nocedal, J. (1989) · Mathematical Programming · doi:10.1007/bf01589116 · Cited by 8,560
Efficient Global Optimization of Expensive Black-Box Functions
Jones, D. R., Schonlau, M., & Welch, W. J. (1998) · Journal of Global Optimization · doi:10.1023/a:1008306431147 · Cited by 8,070
Design and Analysis of Computer Experiments
Sacks, J., Welch, W. J., Mitchell, T. J., & Wynn, H. P. (1989) · Statistical Science · doi:10.1214/ss/1177012413 · Cited by 6,919
Practical Bayesian Optimization of Machine Learning Algorithms
Snoek, J., Larochelle, H., & Adams, R. P. (2012) · arXiv · doi:10.48550/arxiv.1206.2944 · Cited by 6,691
Taking the Human Out of the Loop: A Review of Bayesian Optimization
Shahriari, B., Swersky, K., Wang, Z., Adams, R. P., & de Freitas, N. (2016) · Proceedings of the IEEE · doi:10.1109/jproc.2015.2494218 · Cited by 6,049
On the Experimental Attainment of Optimum Conditions
Box, G. E. P., & Wilson, K. B. (1951) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1951.tb00067.x · Cited by 4,464
(2011) · Cited by 3,939
Design and Analysis of Experiments
Dean, A., Voss, D., & Draguljić, D. (2017) · Springer Texts in Statistics · doi:10.1007/978-3-319-52250-0 · Cited by 2,891
Sequential Model-Based Optimization for General Algorithm Configuration
Hutter, F., Hoos, H. H., & Leyton-Brown, K. (2011) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-25566-3_40 · Cited by 2,469
Brochu, E., Cora, V. M., & de Freitas, N. (2010) · arXiv (Cornell University) · doi:10.48550/arxiv.1012.2599 · Cited by 2,011
Lipschitzian optimization without the Lipschitz constant
Jones, D. R., Perttunen, C. D., & Stuckman, B. E. (1993) · Journal of Optimization Theory and Applications · doi:10.1007/bf00941892 · Cited by 1,976
Stochastic ranking for constrained evolutionary optimization
Runarsson, T. P., & Yao, X. (2000) · IEEE Transactions on Evolutionary Computation · doi:10.1109/4235.873238 · Cited by 1,807
Review of Metamodeling Techniques in Support of Engineering Design Optimization
Wang, G. G., & Shan, S. (2007) · Journal of Mechanical Design · doi:10.1115/1.2429697 · Cited by 1,706
Auto-WEKA: combined selection and hyperparameter optimization of classification algorithms
Thornton, C., Hutter, F., Hoos, H. H., & Leyton-Brown, K. (2013) · Proceedings of the 19th ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/2487575.2487629 · Cited by 1,359
Knowles, J. (2006) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2005.851274 · Cited by 1,254
A New Method of Locating the Maximum Point of an Arbitrary Multipeak Curve in the Presence of Noise
Kushner, H. J. (1964) · Journal of Basic Engineering · doi:10.1115/1.3653121 · Cited by 1,082
Gómez-Bombarelli, R., Aguilera-Iparraguirre, J., Hirzel, T. D., Duvenaud, D., Maclaurin, D., Blood-Forsythe, M. A., Chae, H. S., Einzinger, M., Ha, D.-G., Wu, T., et al. (2016) · Nature Materials · doi:10.1038/nmat4717 · Cited by 1,060
Robots that can adapt like animals
Cully, A., Clune, J., Tarapore, D., & Mouret, J.-B. (2015) · Nature · doi:10.1038/nature14422 · Cited by 979
Response surface methodology process and product optimization using designed experiments
Myers, R. H., Montgomery, D. C., & Anderson‐Cook, C. M. (2002) · Cited by 821
Accelerated search for materials with targeted properties by adaptive design
Xue, D., Balachandran, P. V., Hogden, J., Theiler, J., Xue, D., & Lookman, T. (2016) · Nature Communications · doi:10.1038/ncomms11241 · Cited by 801
Bayesian Optimization with Inequality Constraints
Gardner, J. R., Kusner, M. J., Zhixiang, Weinberger, K. Q., & Cunningham, J. P. (2014) · PolyPublie (École Polytechnique de Montréal) · Cited by 764
Response Surface Methodology: A Retrospective and Literature Survey
Myers, R. H., Montgomery, D. C., Vining, G. G., Borror, C. M., & Kowalski, S. M. (2004) · Journal of Quality Technology · doi:10.1080/00224065.2004.11980252 · Cited by 704
Introduction to Quality Engineering: Designing Quality Into Products and Processes
Parr, W. C. (1989) · Technometrics · doi:10.1080/00401706.1989.10488520 · Cited by 629
Shan, S., & Wang, G. G. (2010) · Structural and Multidisciplinary Optimization · doi:10.1007/s00158-009-0420-2 · Cited by 597
Multi-Task Bayesian Optimization
Swersky, K., Snoek, J., & Adams, R. P. (2013) · Digital Access to Scholarship at Harvard (DASH) (Harvard University) · Cited by 502
Seko, A., Togo, A., Hayashi, H., Tsuda, K., Chaput, L., & Tanaka, I. (2015) · Physical Review Letters · doi:10.1103/physrevlett.115.205901 · Cited by 455
Liu, H., Ong, Y.-S., & Cai, J. (2018) · Structural and Multidisciplinary Optimization · doi:10.1007/s00158-017-1739-8 · Cited by 444
Viana, F. A. C., Simpson, T. W., Balabanov, V., & Toropov, V. (2014) · AIAA Journal · doi:10.2514/1.j052375 · Cited by 377
Design of computer experiments: A review
Garud, S. S., Karimi, I. A., & Kraft, M. (2017) · Computers & Chemical Engineering · doi:10.1016/j.compchemeng.2017.05.010 · Cited by 348
COMBO: An efficient Bayesian optimization library for materials science
Ueno, T., Rhone, T. D., Hou, Z., Mizoguchi, T., & Tsuda, K. (2016) · Materials Discovery · doi:10.1016/j.md.2016.04.001 · Cited by 309
Seko, A., Maekawa, T., Tsuda, K., & Tanaka, I. (2014) · Physical Review B · doi:10.1103/physrevb.89.054303 · Cited by 306
Bayesian Optimization with Unknown Constraints
Gelbart, M. A., Snoek, J., & Adams, R. P. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1403.5607 · Cited by 299
Collaborative hyperparameter tuning
Bardenet, R., Brendel, M., gl, B. Z. K., & le Sebag, M. (2013) · HAL · Cited by 293
Garrido-Merchán, E. C., & Hernández-Lobato, D. (2020) · Neurocomputing · doi:10.1016/j.neucom.2019.11.004 · Cited by 291
GPflow: A Gaussian process library using TensorFlow
Matthews, A., van der Wilk, M., Nickson, T., Fujii, K., Boukouvalas, A., León-Villagrá, P., Ghahramani, Z., & Hensman, J. J. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1610.08733 · Cited by 289
Designing Nanostructures for Phonon Transport via Bayesian Optimization
Ju, S., Shiga, T., Feng, L., Hou, Z., Tsuda, K., & Shiomi, J. (2017) · Physical Review X · doi:10.1103/physrevx.7.021024 · Cited by 282
Calandra, R., Seyfarth, A., Peters, J., & Deisenroth, M. P. (2016) · Annals of Mathematics and Artificial Intelligence · doi:10.1007/s10472-015-9463-9 · Cited by 280
Efficient Transfer Learning Method for Automatic Hyperparameter Tuning
Yogatama, D., & Mann, G. (2014) · International Conference on Artificial Intelligence and Statistics · Cited by 254
Bayesian optimization in high dimensions via random embeddings
Wang, Z., Zoghi, M., Hutter, F., Matheson, D. S., & de Freitas, N. (2013) · UvA-DARE (University of Amsterdam) · Cited by 252
Martínez-Cantín, R. (2014) · Zaguan (Universidad de Zaragoza) · doi:10.48550/arxiv.1405.7430 · Cited by 238
Bayesian Optimization for Materials Design
Frazier, P. I., & Wang, J. (2016) · Springer Series in Materials Science · doi:10.1007/978-3-319-23871-5_3 · Cited by 228
Ponweiser, W., Wagner, T., Biermann, D., & Vincze, M. (2008) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-87700-4_78 · Cited by 224
Predictive Entropy Search for Multi-objective Bayesian OptimizationPreprint
Hernández-Lobato, D., Hernández-Lobato, J. M., Shah, A., & Adams, R. P. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1511.05467 · Cited by 216
Batch Bayesian Optimization via Local PenalizationPreprint
González, J., Dai, Z., Hennig, P., et al. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1505.08052 · Cited by 214
Duvenaud, D., Nickisch, H., & Rasmussen, C. E. (2011) · arXiv (Cornell University) · doi:10.48550/arxiv.1112.4394 · Cited by 183
(2007) · Cited by 175
High Dimensional Bayesian Optimisation and Bandits via Additive ModelsPreprint
Kandasamy, K., Schneider, J., & Póczos, B. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1503.01673 · Cited by 173
Multi-objective Optimization for Materials Discovery via Adaptive Design
Gopakumar, A. M., Balachandran, P. V., Xue, D., Gubernatis, J. E., & Lookman, T. (2018) · Scientific Reports · doi:10.1038/s41598-018-21936-3 · Cited by 171
Efficient high dimensional Bayesian optimization with additivity and quadrature Fourier features
Mutný, M., & Krause, A. (2019) · Repository for Publications and Research Data (ETH Zurich) · doi:10.3929/ethz-b-000309658 · Cited by 159
A Multi-points Criterion for Deterministic Parallel Global Optimization based on Gaussian Processes
Ginsbourger, D., Riche, R. L., Carraro, L., Ginsbourger, D., Riche, R. L., Carraro, L., Multi-points, A., Deter, C., Hal, H. I., Ginsbourger, D., et al. (2008) · HAL · Cited by 151
Parallel Gaussian process optimization with upper confidence bound and pure explorationPreprint
Contal, E., Buffoni, D., Robicquet, R., & Vayatis, N. (2013) · Cited by 151
The Parallel Knowledge Gradient Method for Batch Bayesian OptimizationPreprint
Wu, J., & Frazier, P. I. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1606.04414 · Cited by 148
A Bayesian approach to constrained single- and multi-objective optimization
Feliot, P., Bect, J., & Vázquez, E. (2016) · Journal of Global Optimization · doi:10.1007/s10898-016-0427-3 · Cited by 147
Multi-fidelity Bayesian Optimisation with Continuous ApproximationsPreprint
Kandasamy, K., Dasarathy, G., Schneider, J., & Póczos, B. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1703.06240 · Cited by 139
Gaussian processes with monotonicity information
Riihimäki, J., & Vehtari, A. (2010) · Cited by 136
Batch Bayesian Optimization via Simulation Matching
Azimi, J., Fern, A., & Fern, X. Z. (2010) · neural information processing systems · Cited by 133
High Dimensional Bayesian Optimization using Dropout
Li, C., Gupta, S., Rana, S., Nguyen, V., Venkatesh, S., & Shilton, A. (2017) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2017/291 · Cited by 132
Self-citationEnhanced Higgs Boson to τ+τ− Search with Deep Learning
Baldi, P., Sadowski, P., & Whiteson, D. (2015) · Physical Review Letters · doi:10.1103/physrevlett.114.111801 · Cited by 131
Rapid Bayesian optimisation for synthesis of short polymer fiber materials
Li, C., Rubin, D., Rana, S., Gupta, S., Sutti, A., Greenhill, S., Slezak, T., Height, M. J., & Venkatesh, S. (2017) · Scientific Reports · doi:10.1038/s41598-017-05723-0 · Cited by 130
Self-citationMultiobjective optimization using Gaussian process emulators via stepwise uncertainty reduction
Picheny, V. (2014) · Statistics and Computing · doi:10.1007/s11222-014-9477-x · Cited by 127
Statistical inference and adaptive design for materials discovery
Lookman, T., Balachandran, P. V., Xue, D., Hogden, J., & Theiler, J. P. (2016) · Current Opinion in Solid State and Materials Science · doi:10.1016/j.cossms.2016.10.002 · Cited by 127
Marco, A., Berkenkamp, F., Hennig, P., Schoellig, A. P., Krause, A., Schaal, S., & Trimpe, S. (2017) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2017.7989186 · Cited by 120
High-Dimensional Gaussian Process Bandits
Djolonga, J., Krause, A., & Cevher, V. (2013) · Infoscience (Ecole Polytechnique Fédérale de Lausanne) · Cited by 116
Perdikaris, P. G., & Karniadakis, G. E. (2016) · Journal of The Royal Society Interface · doi:10.1098/rsif.2015.1107 · Cited by 106
Predictive Entropy Search for Multi-objective Bayesian Optimization with Constraints
Garrido‐Merchán, E. C., & Hernández-Lobato, D. (2019) · Neurocomputing · doi:10.1016/j.neucom.2019.06.025 · Cited by 105
Predictive Entropy Search for Bayesian Optimization with Unknown ConstraintsPreprint
Hernández-Lobato, J. M., Gelbart, M. A., Hoffman, M. D., Adams, R. P., & Zoubin Ghahramani, A. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1502.05312 · Cited by 102
Adaptive and Safe Bayesian Optimization in High Dimensions via One-Dimensional SubspacesPreprint
Kirschner, J., Mutný, M., Hiller, N., Ischebeck, R., & Krause, A. (2019) · arXiv (Cornell University) · doi:10.3929/ethz-b-000385951 · Cited by 98
Active Learning from Weak and Strong LabelersPreprint
Zhang, C., & Chaudhuri, K. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1510.02847 · Cited by 96
Lorenz, R., Monti, R. P., Violante, I. R., Anagnostopoulos, C., Faisal, A. A., Montana, G., & Leech, R. (2016) · NeuroImage · doi:10.1016/j.neuroimage.2016.01.032 · Cited by 95
BOCK : Bayesian Optimization with Cylindrical KernelsPreprint
Oh, C., Gavves, E., & Welling, M. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1806.01619 · Cited by 93
Parallel Gaussian Process Optimization with Upper Confidence Bound and Pure Exploration
Contal, E., Buffoni, D., Robicquet, A., & Vayatis, N. (2013) · Lecture notes in computer science · doi:10.1007/978-3-642-40988-2_15 · Cited by 85
Raiders of the Lost Architecture: Kernels for Bayesian Optimization in Conditional Parameter SpacesPreprint
Swersky, K., Duvenaud, D., Snoek, J., Hutter, F., & Osborne, M. A. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1409.4011 · Cited by 82
Designing Engaging Games Using Bayesian Optimization
Khajah, M. M., Roads, B. D., Lindsey, R., Liu, Y.-E., & Mozer, M. C. (2016) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/2858036.2858253 · Cited by 78
Batch Bayesian optimization using multi-scale search
Joy, T. T., Rana, S., Gupta, S., & Venkatesh, S. (2019) · Knowledge-Based Systems · doi:10.1016/j.knosys.2019.06.026 · Cited by 78
Self-citationBayesian Optimization for Neuroimaging Pre-processing in Brain Age Classification and Prediction
Lancaster, J., Lorenz, R., Leech, R., & Cole, J. H. (2018) · Frontiers in Aging Neuroscience · doi:10.3389/fnagi.2018.00028 · Cited by 76
The computation of the expected improvement in dominated hypervolume of Pareto front approximations
Emmerich, M., Klinkenberg, J.-W., & Bohrweg, N. (2008) · Cited by 75
High Dimensional Bayesian Optimization with Elastic Gaussian Process
Rana, S., Li, C., Gupta, S., Nguyen, V., & Venkatesh, S. (2017) · Figshare · Cited by 71
Self-citationReinforcement learning with multi-fidelity simulators
Cutler, M., Walsh, T. J., & How, J. P. (2014) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2014.6907423 · Cited by 64
High Dimensional Bayesian Optimization via Restricted Projection Pursuit Models
Li, C., Kandasamy, K., Póczos, B., & Schneider, J. (2016) · International Conference on Artificial Intelligence and Statistics · Cited by 62
Parallel Bayesian Global Optimization of Expensive FunctionsPreprint
Wang, J., Clark, S., Liu, E., & Frazier, P. I. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1602.05149 · Cited by 61
Dissociating frontoparietal brain networks with neuroadaptive Bayesian optimization
Lorenz, R., Violante, I. R., Monti, R. P., Montana, G., Hampshire, A., & Leech, R. (2018) · Nature Communications · doi:10.1038/s41467-018-03657-3 · Cited by 58
Design of Experiments for Screening
Woods, D. C., & Lewis, S. (2015) · Springer eBooks · doi:10.1007/978-3-319-11259-6_33-1 · Cited by 56
Discovering and Exploiting Additive Structure for Bayesian Optimization
Gardner, J. R., Guo, C., Weinberger, K. Q., Garnett, R., & Grosse, R. (2017) · International Conference on Artificial Intelligence and Statistics · Cited by 56
Bayesian optimization under mixed constraints with a slack-variable augmented LagrangianPreprint
Picheny, V., Gramacy, R. B., Wild, S. M., & Digabel, S. L. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1605.09466 · Cited by 53
Bayesian optimization for efficient determination of metal oxide grain boundary structures
Kikuchi, S., Oda, H., Kiyohara, S., & Mizoguchi, T. (2017) · Physica B Condensed Matter · doi:10.1016/j.physb.2017.03.006 · Cited by 46
Bayesian optimization for maximum power point tracking in photovoltaic power plants
Abdelrahman, H., Berkenkamp, F., Poland, J., & Krause, A. (2016) · 2016 European Control Conference (ECC) · doi:10.1109/ecc.2016.7810598 · Cited by 45
ADMMBO: Bayesian Optimization with Unknown Constraints using ADMM.
Ariafar, S., Coll‐Font, J., Brooks, D. H., & Dy, J. (2019) · PubMed · Cited by 45
Selecting Near-Optimal Learners via Incremental Data Allocation
Sabharwal, A., Samulowitz, H., & Tesauro, G. J. (2016) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v30i1.10316 · Cited by 43
Vieira, H., Sanchez, S. M., Kienitz, K. H., & Belderrain, M. C. N. (2013) · Journal of Simulation · doi:10.1057/jos.2013.14 · Cited by 34
Information-Theoretic Transfer Learning Framework for Bayesian Optimisation
Ramachandran, A., Gupta, S., Rana, S., & Venkatesh, S. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-10928-8_49 · Cited by 20
Self-citationProcess-constrained batch Bayesian optimisation
Vellanki, P., Rana, S., Gupta, S., Rubin, D., Sutti, A., Dorin, T., Height, M. J., Sanders, P. G., & Venkatesh, S. (2017) · Deakin Research Online (Deakin University) · Cited by 16
Self-citationQuantile Stein Variational Gradient Descent for Batch Bayesian Optimization
Gong, C., Peng, J., & Liu, Q. (2019) · International Conference on Machine Learning · Cited by 14
An investigation into new kernels for categorical variables
García, V., & Antônio, M. (2013) · RECERCAT (Consorci de Serveis Universitaris de Catalunya) · Cited by 2
Metadata
- Authors
- Greenhill, S., Rana, S., Gupta, S., Vellanki, P., & Venkatesh, S.
- Venue
- IEEE Access
- Published
- 2020
- Volume
- 8
- Pages
- 13937-13948
- ISSN
- 2169-3536 (ISSN-L)
- OpenAlex
- W2998788451
- Cited by
- 520
- References
- 95
- FWCI
- 29.64
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.