The DOI matches its OpenAlex record; 70 of the 70 references it cites were found in a registry or an index.
A Tutorial on Bayesian Optimization of Expensive Cost Functions, with Application to Active User Modeling and Hierarchical Reinforcement Learning
Open accessOverview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Nonparametric Statistics for the Behavioral Sciences
Guitton, H., & Siegel, S. (1958) · Revue économique · doi:10.2307/3498751 · Cited by 35,245
Reinforcement Learning: An Introduction
(2005) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2004.842673 · Cited by 24,496
Reducing the dimensionality of data with neural networks
Hinton, G. E., & Salakhutdinov, R. R. (2006) · Science · doi:10.1126/science.1127647 · Cited by 20,928
Advances in prospect theory: Cumulative representation of uncertainty
Tversky, A., & Kahneman, D. (1992) · Journal of Risk and Uncertainty · doi:10.1007/bf00122574 · Cited by 15,467 · cited 1×
“Prospect theory, for example, employs utility models based on relation to a reference point, based on evidence that the human perceptual apparatus is attuned to evaluate differences rather than absolute magnitudes [Kahneman and Tversky, 1979, Tversky and Kahneman, 1992].”
BackgroundEfficient Global Optimization of Expensive Black-Box Functions
Jones, D. R., Schonlau, M., & Welch, W. J. (1998) · Journal of Global Optimization · doi:10.1023/a:1008306431147 · Cited by 8,070
Design and Analysis of Computer Experiments
Sacks, J., Welch, W. J., Mitchell, T. J., & Wynn, H. P. (1989) · Statistical Science · doi:10.1214/ss/1177012413 · Cited by 6,919
Kendall, M. G. (1957) · Biometrika · doi:10.2307/2333282 · Cited by 6,383
(2009) · Minds at UW (University of Wisconsin) · Cited by 4,791
(2012) · Encyclopedia of the Sciences of Learning · doi:10.1007/978-1-4419-1428-6_5086 · Cited by 3,515
Leave, C. (1994) · Journal of the Operational Research Society · doi:10.1057/jors.1994.133 · Cited by 3,309
Between MDPs and semi-MDPs: A framework for temporal abstraction in reinforcement learning
Sutton, R. S., Precup, D., & Singh, S. (1999) · Artificial Intelligence · doi:10.1016/s0004-3702(99)00052-1 · Cited by 3,119
A practical Bayesian framework for backpropagation networks
MacKay, D. J. C. (1992) · Neural Computation · doi:10.1162/neco.1992.4.3.448 · Cited by 2,917
A statistical approach to some basic mine valuation problems on the Witwatersrand
Krige, D. G. (1951) · Journal of the Southern African Institute of Mining and Metallurgy · Cited by 2,409
Diggle, P. J., Tawn, J. A., & Moyeed, R. A. (1998) · Journal of the Royal Statistical Society Series C: Applied Statistics · doi:10.1111/1467-9876.00113 · Cited by 2,174
A Taxonomy of Global Optimization Methods Based on Response Surfaces
Jones, D. R. (2001) · Journal of Global Optimization · doi:10.1023/a:1012771025575 · Cited by 2,159
Lipschitzian optimization without the Lipschitz constant
Jones, D. R., Perttunen, C. D., & Stuckman, B. E. (1993) · Journal of Optimization Theory and Applications · doi:10.1007/bf00941892 · Cited by 1,976
Information-Theoretic Regret Bounds for Gaussian Process Optimization in the Bandit Setting
Srinivas, N., Krause, A., Kakade, S. M., & Seeger, M. W. (2012) · IEEE Transactions on Information Theory · doi:10.1109/tit.2011.2182033 · Cited by 1,850
A sequential algorithm for training text classifiers
Lewis, D., & Gale, W. A. (1994) · arXiv (Cornell University) · doi:10.5555/188490.188495 · Cited by 1,731
Törn, A., & Žilinskas, A. (1989) · Cited by 1,673
Hierarchical Reinforcement Learning with the MAXQ Value Function Decomposition
Dietterich, T. G. (2000) · Journal of Artificial Intelligence Research · doi:10.1613/jair.639 · Cited by 1,435
Recent Advances in Hierarchical Reinforcement Learning
Barto, A. G., & Mahadevan, S. (2003) · Discrete Event Dynamic Systems · doi:10.1023/a:1022140919877 · Cited by 1,024
Stochastic Approximation Algorithms and Applications
Puhalskii, A., Kushner, H. J., & Yin, G. G. (1998) · Journal of the American Statistical Association · doi:10.2307/2669885 · Cited by 994
Prospect Theory. An Analysis of Decision Making Under Risk
Kahneman, D., & Tversky, A. (1977) · doi:10.21236/ada045771 · Cited by 865
KrauseAndreas, SinghAjit, & GuestrinCarlos (2008) · Journal of Machine Learning Research · doi:10.5555/1390681.1390689 · Cited by 815
Econometric Models for Probabilistic Choice Among Products
McFadden, D. (1980) · The Journal of Business · doi:10.1086/296093 · Cited by 766
TrueSkill™: A Bayesian Skill Rating System
Herbrich, R., Minka, T., & Graepel, T. (2007) · Advances in Neural Information Processing Systems 19 · doi:10.7551/mitpress/7503.003.0076 · Cited by 639
Global Optimization of Stochastic Black-Box Systems via Sequential Kriging Meta-Models
Huang, D., Allen, T. T., Notz, W. I., & Zeng, N. (2006) · Journal of Global Optimization · doi:10.1007/s10898-005-2454-3 · Cited by 625
Classes of kernels for machine learning: a statistics perspective
Genton, M. G. (2002) · doi:10.5555/944790.944815 · Cited by 607
Bayesian auxiliary variable models for binary and multinomial regression
Held, L., & Holmes, C. C. (2006) · Bayesian Analysis · doi:10.1214/06-ba105 · Cited by 434
Application of Bayesian approach to numerical methods of global and stochastic optimization
Mockus, J. (1994) · Journal of Global Optimization · doi:10.1007/bf01099263 · Cited by 399
Computer experiments and global optimization
Welch, W. J., & Schonlau, M. (1997) · Library and Archives Canada (Government of Canada) · Cited by 382
Preference learning with Gaussian processes
Chu, W., & Ghahramani, Z. (2005) · Proceedings of the 22nd international conference on Machine learning - ICML '05 · doi:10.1145/1102351.1102369 · Cited by 361
PEGASUS: A Policy Search Method for Large MDPs and POMDPs
Ng, A. Y., & Jordan, M. I. (2013) · arXiv (Cornell University) · doi:10.48550/arxiv.1301.3878 · Cited by 360
Mosteller, F. (1951) · Psychometrika · doi:10.1007/bf02313422 · Cited by 343
Active Learning with Gaussian Processes for Object Categorization
Kapoor, A., Grauman, K., Urtasun, R., & Darrell, T. (2007) · 2007 IEEE 11th International Conference on Computer Vision · doi:10.1109/iccv.2007.4408844 · Cited by 322
A statistical method for global optimization
Cox, D. D., & John, S. (2003) · [Proceedings] 1992 IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/icsmc.1992.271617 · Cited by 302
Sequential Parameter Optimization
Bartz-Beielstein, T., Lasarczyk, C. W. G., & Preuss, M. (2005) · 2005 IEEE Congress on Evolutionary Computation · doi:10.1109/cec.2005.1554761 · Cited by 300
The Bayesian approach to global optimization
Mockus, J. (2005) · Lecture Notes in Control and Information Sciences · doi:10.1007/bfb0006170 · Cited by 283
Regression with Input-dependent Noise: A Gaussian Process Treatment
Goldberg, P. W., Williams, C. K. I., & Bishop, C. (1997) · Aston Publications Explorer (Aston University) · Cited by 275
Automatic gait optimization with Gaussian process regression
Lizotte, D. J., Wang, T., Bowling, M., & Schuurmans, D. (2007) · Cited by 237
Hierarchical control and learning for markov decision processes
Parr, R., & Russell, S. (1998) · Cited by 221
Martinez-Cantin, R., de Freitas, N., Brochu, E., Castellanos, J., & Doucet, A. (2009) · Autonomous Robots · doi:10.1007/s10514-009-9130-2 · Cited by 217
Self-citationPractical Bayesian optimization
Lizotte, D. J. (2008) · ERA: Education and Research Archive (University of Alberta) · doi:10.7939/r3-379f-gw15 · Cited by 215
A surrogate-model-based method for constrained optimization
Audet, C., Denni, J., Moore, D., Booker, A. J., & Frank, P. D. (2000) · AIAA/ISSMO Multidisciplinary Analysis and Optimization Conference (MAO) · doi:10.2514/6.2000-4891 · Cited by 213
Bayesian optimization for sensor set selection
Garnett, R., Osborne, M. A., & Roberts, S. (2010) · ACM/IEEE International Conference on Information Processing in Sensor Networks (IPSN) · doi:10.1145/1791212.1791238 · Cited by 146
Active Policy Learning for Robot Planning and Exploration under Uncertainty
Martínez-Cantín, R., de Freitas, N., Arnaud Doucet, B., & Castellanos, J. A. (2007) · Robotics: Science and Systems · doi:10.15607/rss.2007.iii.041 · Cited by 140
Self-citationSequential design of computer experiments to minimize integrated response functions
Notz, W. I., Santner, T. J., & Williams, B. J. (2000) · Cited by 135
Portfolio Allocation for Bayesian OptimizationPreprint
Brochu, E., Hoffman, M. W., & de Freitas, N. (2010) · arXiv (Cornell University) · doi:10.48550/arxiv.1009.5419 · Cited by 133
Self-citationBatch Bayesian Optimization via Simulation Matching
Azimi, J., Fern, A., & Fern, X. Z. (2010) · neural information processing systems · Cited by 133
A Bayesian interactive optimization approach to procedural animation design
Brochu, E., Brochu, T., & de Freitas, N. (2010) · doi:10.5555/1921427.1921443 · Cited by 132
Self-citationActive Preference Learning with Discrete Choice Data
Brochu, E., de Freitas, N., & Ghosh, A. (2007) · Cited by 125
Self-citationBayesian Algorithms for One-Dimensional Global Optimization
Locatelli, M. (1997) · Journal of Global Optimization · doi:10.1023/a:1008294716304 · Cited by 122
An experimental investigation of model-based parameter optimisation: SPO and beyond
Hutter, F., Hoos, H. H., Leyton‐Brown, K., & Murphy, K. P. (2009) · Genetic and Evolutionary Computation Conference (GECCO) · doi:10.1145/1569901.1569940 · Cited by 122
Programmable Reinforcement Learning Agents
André, D., & Russell, S. (2000) · Cited by 106
Bayesian methods in global optimization
Betr�, B. (1991) · Journal of Global Optimization · doi:10.1007/bf00120661 · Cited by 97
Hierarchical adaptive experimental design for Gaussian process emulators
Busby, D. (2008) · Reliability Engineering & System Safety · doi:10.1016/j.ress.2008.07.007 · Cited by 86
A global search method for optimizing nonlinear systems
Stuckman, B. E. (1988) · IEEE Transactions on Systems Man and Cybernetics · doi:10.1109/21.23094 · Cited by 77
Sequential Bayesian Prediction in the Presence of Changepoints and Faults
Garnett, R., Osborne, M. A., Reece, S., Rogers, A., & Roberts, S. (2010) · The Computer Journal · doi:10.1093/comjnl/bxq003 · Cited by 77
Gaussian process priors with ARMA noise models
Murray‐Smith, R., & Girard, A. (2001) · ENLIGHTEN (Jurnal Bimbingan dan Konseling Islam) · Cited by 51
Extensions of Gaussian processes for ranking: semi-supervised and active learning
Chu, W., & Ghahramani, Z. (2005) · Cited by 46
Martínez-Cantín, R., de Freitas, N., & Castellanos, J. A. (2007) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/robot.2007.363681 · Cited by 46
Self-citationUsing Gaussian Processes to Optimize Expensive Functions
Frean, M. R., & Boyle, P. (2008) · Lecture notes in computer science · doi:10.1007/978-3-540-89378-3_25 · Cited by 45
Comparison of public-domain software for black box global optimization∗
Mongeau, M., Karsenty, H., Rouzé, V., & Hiriart‐Urruty, J. (2000) · Optimization methods & software · doi:10.1080/10556780008805783 · Cited by 45
Global optimization based on a statistical model and simplicial partitioning
Žilinskas, A., & Žilinskas, J. (2002) · Computers & Mathematics with Applications · doi:10.1016/s0898-1221(02)00206-7 · Cited by 44
Active Data Selection for Sensor Networks with Faults and Changepoints
Osborne, M. A., Garnett, R., & Roberts, S. (2010) · International Conference on Advanced Information Networking and Applications (AINA) · doi:10.1109/aina.2010.36 · Cited by 24
Global R/sup d/ optimization when probes are expensive: the GROPE algorithm
Elder, J. F. (2003) · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/icsmc.1992.271711 · Cited by 18
On the convergence of the expected improvement algorithmPreprint
Vázquez, E., & Bect, J. (2007) · arXiv (Cornell University) · Cited by 13
Convergence properties of the expected improvement algorithmPreprint
Vázquez, E., & Bect, J. (2007) · arXiv (Cornell University) · doi:10.48550/arxiv.0712.3744 · Cited by 10
Preference galleries for material design
Brochu, E., Ghosh, A., & de Freitas, N. (2007) · ACM SIGGRAPH Posters · doi:10.1145/1280720.1280834 · Cited by 10
Self-citationHierarchical reinforcement learning in continuous state and multi-agent environments
Ghavamzadeh, M., & Mahadevan, S. (2005) · Cited by 9
Cited by
Practical Bayesian Optimization of Machine Learning Algorithms
Snoek, J., Larochelle, H., & Adams, R. P. (2012) · arXiv · doi:10.48550/arxiv.1206.2944 · Cited by 6,691
Taking the Human Out of the Loop: A Review of Bayesian Optimization
Shahriari, B., Swersky, K., Wang, Z., Adams, R. P., & de Freitas, N. (2016) · Proceedings of the IEEE · doi:10.1109/jproc.2015.2494218 · Cited by 6,049
Probabilistic machine learning and artificial intelligence
Ghahramani, Z. (2015) · Nature · doi:10.1038/nature14541 · Cited by 1,995
Information-Theoretic Regret Bounds for Gaussian Process Optimization in the Bandit Setting
Srinivas, N., Krause, A., Kakade, S. M., & Seeger, M. W. (2012) · IEEE Transactions on Information Theory · doi:10.1109/tit.2011.2182033 · Cited by 1,850
Automated Machine Learning: Methods, Systems, Challenges
(2019) · The Springer Series on Challenges in Machine Learning · doi:10.1007/978-3-030-05318-5 · Cited by 1,485
Metadata
- Authors
- Brochu, E., Cora, V. M., & de Freitas, N.
- Venue
- arXiv (Cornell University)
- Publisher
- Cornell University
- Published
- 2010-12-12
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1012.2599
- OpenAlex
- W2099201756
- Cited by
- 2,011
- References
- 70
- Type
- posted content
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.