The DOI matches its OpenAlex record; 59 of the 59 references it cites were found in a registry or an index.
A Tutorial on Bayesian Optimization
Open accessOverview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Elements of Information Theory
Cover, T. M., & Thomas, J. A. (2001) · Wiley eBooks · doi:10.1002/0471200611 · Cited by 36,808
Reinforcement Learning: An Introduction
(2005) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2004.842673 · Cited by 24,496
A Stochastic Approximation Method
Robbins, H., & Monro, S. (1951) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177729586 · Cited by 9,643
Reinforcement Learning: A Survey
Kaelbling, L. P., Littman, M. L., & Moore, A. W. (1996) · Journal of Artificial Intelligence Research · doi:10.1613/jair.301 · Cited by 8,972
On the limited memory BFGS method for large scale optimization
Liu, D. C., & Nocedal, J. (1989) · Mathematical Programming · doi:10.1007/bf01589116 · Cited by 8,560
Efficient Global Optimization of Expensive Black-Box Functions
Jones, D. R., Schonlau, M., & Welch, W. J. (1998) · Journal of Global Optimization · doi:10.1023/a:1008306431147 · Cited by 8,070 · cited 6×
“Over a longer period, since the 1960s, BayesOpt has been used extensively for designing engineering systems (Moˇckus, 1989; Jones et al., 1998; Forrester et al., 2008).”
BackgroundMethodInfluentialPractical Bayesian Optimization of Machine Learning Algorithms
Snoek, J., Larochelle, H., & Adams, R. P. (2012) · arXiv · doi:10.48550/arxiv.1206.2944 · Cited by 6,691
Taking the Human Out of the Loop: A Review of Bayesian Optimization
Shahriari, B., Swersky, K., Wang, Z., Adams, R. P., & de Freitas, N. (2016) · Proceedings of the IEEE · doi:10.1109/jproc.2015.2494218 · Cited by 6,049
Approximate Dynamic Programming: Solving the Curses of Dimensionality
Powell, W. B. (2011) · Wiley Series in Probability and Statistics · doi:10.1002/9781118029176 · Cited by 2,297
Brochu, E., Cora, V. M., & de Freitas, N. (2010) · arXiv (Cornell University) · doi:10.48550/arxiv.1012.2599 · Cited by 2,011
Stochastic Gradient Descent Tricks
Bottou, L. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-35289-8_25 · Cited by 1,929
Engineering Design via Surrogate Modelling: A Practical Guide
Keane, A., Forrester, A., & Sobester, A. (2008) · American Institute of Aeronautics and Astronautics eBooks · doi:10.2514/4.479557 · Cited by 1,686
Knowles, J. (2006) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2005.851274 · Cited by 1,254
Envelope Theorems for Arbitrary Choice Sets
Milgrom, P., & Segal, I. (2002) · Econometrica · doi:10.1111/1468-0262.00296 · Cited by 1,235
Slice SamplingPreprint
Neal, R. M. (2000) · arXiv (Cornell University) · Cited by 1,160
A New Method of Locating the Maximum Point of an Arbitrary Multipeak Curve in the Presence of Noise
Kushner, H. J. (1964) · Journal of Basic Engineering · doi:10.1115/1.3653121 · Cited by 1,082
A rigorous framework for optimization of expensive functions by surrogates
Booker, A. J., Dennis, J. E., Frank, P. D., Serafini, D. B., Torczon, V., & Trosset, M. W. (1999) · Structural Optimization · doi:10.1007/bf01197708 · Cited by 960
A family of algorithms for approximate bayesian inference
Minka, T. P., & Picard, R. W. (2001) · DSpace@MIT (Massachusetts Institute of Technology) · Cited by 882
Bayesian Optimization with Inequality Constraints
Gardner, J. R., Kusner, M. J., Zhixiang, Weinberger, K. Q., & Cunningham, J. P. (2014) · PolyPublie (École Polytechnique de Montréal) · Cited by 764
Roustant, O., Ginsbourger, D., & Deville, Y. (2012) · Journal of Statistical Software · doi:10.18637/jss.v051.i01 · Cited by 594
Multidimensional Stochastic Approximation Methods
Blum, J. R. (1954) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177728659 · Cited by 523
Multi-Task Bayesian Optimization
Swersky, K., Snoek, J., & Adams, R. P. (2013) · Digital Access to Scholarship at Harvard (DASH) (Harvard University) · Cited by 502
A Knowledge-Gradient Policy for Sequential Information Collection
Frazier, P. I., Powell, W. B., & Dayanik, S. (2008) · SIAM Journal on Control and Optimization · doi:10.1137/070693424 · Cited by 447
Self-citationGlobal versus local search in constrained optimization of computer models
Schonlau, M., Welch, W. J., & Jones, D. R. (1998) · Institute of Mathematical Statistics Lecture Notes - Monograph Series · doi:10.1214/lnms/1215456182 · Cited by 435
Fast Bayesian Optimization of Machine Learning Hyperparameters on Large DatasetsPreprint
Klein, A., Falkner, S., Bartels, S., Hennig, P., & Hutter, F. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1605.07079 · Cited by 424
Bayesian Approach to Global Optimization--Theory and Applications.
Boender, C. G. E., & Mockus, J. (1991) · Mathematics of Computation · doi:10.2307/2008419 · Cited by 409
The Knowledge-Gradient Policy for Correlated Normal Beliefs
Frazier, P., Powell, W., & Dayanik, S. (2009) · INFORMS Journal on Computing · doi:10.1287/ijoc.1080.0314 · Cited by 408
Self-citationPredictive Entropy Search for Efficient Global Optimization of Black-box Functions
Hernández-Lobato, J. M., Hoffman, M. W., & Ghahramani, Z. (2014) · arXiv · doi:10.48550/arxiv.1406.2541 · Cited by 407
On Bayesian Methods for Seeking the Extremum
Močkus, J. (1975) · Optimization Techniques IFIP Technical Conference · doi:10.1007/978-3-662-38527-2_55 · Cited by 402
Kriging Is Well-Suited to Parallelize Optimization
Ginsbourger, D., Le Riche, R., & Carraro, L. (2010) · Adaptation Learning and Optimization · doi:10.1007/978-3-642-10701-6_6 · Cited by 396
Bayesian Optimization in a Billion Dimensions via Random Embeddings
Wang, Z., Hutter, F., Zoghi, M., Matheson, D., & De Feitas, N. (2016) · Journal of Artificial Intelligence Research · doi:10.1613/jair.4806 · Cited by 390
High Dimensional Bayesian Optimisation and Bandits via Additive ModelsPreprint
Kandasamy, K., Schneider, J., & Póczos, B. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1503.01673 · Cited by 390
Sasena, M. J. (2002) · Cited by 350
Constrained Global Optimization of Expensive Black Box Functions Using Radial Basis Functions
Regis, R. G., & Shoemaker, C. A. (2005) · Journal of Global Optimization · doi:10.1007/s10898-004-0570-0 · Cited by 331
Statistical Improvement Criteria for Use in Multiobjective Design Optimization
Keane, A. J. (2006) · AIAA Journal · doi:10.2514/1.16875 · Cited by 312
Most likely heteroscedastic Gaussian process regression
Kersting, K., Plagemann, C., Pfaff, P., & Burgard, W. (2007) · Proceedings of the 24th international conference on Machine learning · doi:10.1145/1273496.1273546 · Cited by 311
Freeze-Thaw Bayesian OptimizationPreprint
Swersky, K., Snoek, J., & Adams, R. P. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1406.3896 · Cited by 310
Bayesian optimization in high dimensions via random embeddings
Wang, Z., Zoghi, M., Hutter, F., Matheson, D. S., & de Freitas, N. (2013) · UvA-DARE (University of Amsterdam) · Cited by 252
Automatic gait optimization with Gaussian process regression
Lizotte, D. J., Wang, T., Bowling, M., & Schuurmans, D. (2007) · Cited by 237
Bayesian Optimization for Materials Design
Frazier, P. I., & Wang, J. (2016) · Springer Series in Materials Science · doi:10.1007/978-3-319-23871-5_3 · Cited by 228
Self-citationBayesian Optimization with GradientsPreprint
Wu, J., Poloczek, M., Wilson, A. G., & Frazier, P. I. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1703.04389 · Cited by 220
Self-citationPractical Bayesian optimization
Lizotte, D. J. (2008) · ERA: Education and Research Archive (University of Alberta) · doi:10.7939/r3-379f-gw15 · Cited by 215
Scott, W., Frazier, P., & Powell, W. (2011) · SIAM Journal on Optimization · doi:10.1137/100801275 · Cited by 209
Self-citationMahajan, A., & Teneketzis, D. (2008) · Foundations and Applications of Sensor Management · doi:10.1007/978-0-387-49819-5_6 · Cited by 185
Improved Strategies for Radial basis Function Methods for Global Optimization
Regis, R. G., & Shoemaker, C. A. (2006) · Journal of Global Optimization · doi:10.1007/s10898-006-9040-1 · Cited by 148
The Parallel Knowledge Gradient Method for Batch Bayesian OptimizationPreprint
Wu, J., & Frazier, P. I. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1606.04414 · Cited by 148
Self-citationThe Knowledge-Gradient Algorithm for Sequencing Experiments in Drug Discovery
Negoescu, D. M., Frazier, P. I., & Powell, W. B. (2010) · INFORMS journal on computing · doi:10.1287/ijoc.1100.0417 · Cited by 137
Self-citationSequential design of computer experiments to minimize integrated response functions
Notz, W. I., Santner, T. J., & Williams, B. J. (2000) · Cited by 135
A parallel updating scheme for approximating and optimizing high fidelity computer simulations
Sbester, A., Leary, S., & Keane, A. J. (2004) · Structural and Multidisciplinary Optimization · doi:10.1007/s00158-004-0397-9 · Cited by 118
Predictive Entropy Search for Bayesian Optimization with Unknown ConstraintsPreprint
Hernández-Lobato, J. M., Gelbart, M. A., Hoffman, M. W., Adams, R. P., & Ghahramani, Z. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1502.05312 · Cited by 117
Twenty Questions with Noise: Bayes Optimal Policies for Entropy Loss
Jedynak, B., Frazier, P. I., & Sznitman, R. (2012) · Journal of Applied Probability · doi:10.1239/jap/1331216837 · Cited by 90
Self-citationParallel radial basis function methods for the global optimization of expensive functions
Regis, R. G., & Shoemaker, C. A. (2006) · European Journal of Operational Research · doi:10.1016/j.ejor.2006.08.040 · Cited by 65
Chang, P. B., Williams, B. J., Bhalla, K. S. B., Belknap, T. W., Santner, T. J., Notz, W. I., & Bartel, D. L. (2001) · Journal of Biomechanical Engineering · doi:10.1115/1.1372701 · Cited by 61
Parallel Bayesian Global Optimization of Expensive FunctionsPreprint
Wang, J., Clark, S., Liu, E., & Frazier, P. I. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1602.05149 · Cited by 61
Self-citationBayesian Optimization with Expensive Integrands
Toscano-Palmerin, S., & Frazier, P. I. (2022) · SIAM Journal on Optimization · doi:10.1137/19m1303125 · Cited by 59
Self-citationSequential Bayes-Optimal Policies for Multiple Comparisons with a Known Standard
Xie, J., & Frazier, P. I. (2013) · Operations Research · doi:10.1287/opre.2013.1207 · Cited by 47
Self-citationOne-Dimensional global optimization for observations with noise
Calvin, J. M., & silinskas, A. (2005) · Computers & Mathematics with Applications · doi:10.1016/j.camwa.2004.12.014 · Cited by 33
Average performance of a class of adaptive algorithms for global optimization
Calvin, J. M. (1997) · The Annals of Applied Probability · doi:10.1214/aoap/1034801250 · Cited by 26
Xie, J., Frazier, P. I., Sankaran, S., Marsden, A. L., & Elmohamed, S. (2012) · Allerton Conference on Communication, Control, and Computing · doi:10.1109/allerton.2012.6483247 · Cited by 17
Self-citation
Cited by
A review of uncertainty quantification in deep learning: Techniques, applications and challenges
Abdar, M., Pourpanah, F., Hussain, S., Rezazadegan, D., Liu, L., Ghavamzadeh, M., Fieguth, P., Cao, X., Khosravi, A., Acharya, U. R., et al. (2021) · Information Fusion · doi:10.1016/j.inffus.2021.05.008 · Cited by 3,111
Benchmark and Survey of Automated Machine Learning Frameworks
Zöller, M.-A., & Huber, M. F. (2021) · Journal of Artificial Intelligence Research · doi:10.1613/jair.1.11854 · Cited by 448
Hyper-Parameter Optimization: A Review of Algorithms and Applications
Yu, T., & Zhu, H. C. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2003.05689 · Cited by 437
Accelerating high-throughput virtual screening through molecular pool-based active learning
Graff, D. E., Shakhnovich, E. I., & Coley, C. W. (2021) · Chemical Science · doi:10.1039/d0sc06805e · Cited by 302
BANANAS: Bayesian Optimization with Neural Architectures for Neural Architecture Search
White, C., Neiswanger, W., & Savani, Y. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i12.17233 · Cited by 261
Metadata
- Authors
- Frazier, P. I.
- Venue
- arXiv (Cornell University)
- Publisher
- Cornell University
- Published
- 2018-07-08
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1807.02811
- OpenAlex
- W2873705236
- Cited by
- 342
- References
- 59
- Type
- posted content
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.