CoChat
Sign Up
PreprintCited by 407Advanced Bandit Algorithms ResearchAdvanced Multi-Objective Optimization AlgorithmsGaussian Processes and Bayesian Inference

The DOI matches its DataCite record; 3 of the 3 references it cites were found in a registry or an index.

Predictive Entropy Search for Efficient Global Optimization of Black-box Functions

Open access
Hernández-Lobato, José Miguel, Hoffman, Matthew W., Ghahramani, Zoubin·2014·arXiv
DOI 10.48550/arxiv.1406.2541arXiv 1406.2541
Open this paper in CoChat — free accountOpen PDF

Abstract

We propose a novel information-theoretic approach for Bayesian optimization called Predictive Entropy Search (PES). At each iteration, PES selects the next evaluation point that maximizes the expected information gained with respect to the global maximum. PES codifies this intractable acquisition function in terms of the expected reduction in the differential entropy of the predictive distribution. This reformulation allows PES to obtain approximations that are both more accurate and efficient than other alternatives such as Entropy Search (ES). Furthermore, PES can easily perform a fully Bayesian treatment of the model hyperparameters while ES cannot. We evaluate PES in both synthetic and real-world applications, including optimization problems in machine learning, finance, biotechnology, and robotics. We show that the increased accuracy of PES leads to significant gains in optimization performance.

Overview

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

DataCite · 10.48550/arxiv.1406.2541

Cites

3 of 3 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Epistemic uncertainty is used to guide methods that require exploration like active learning, continual learning, Bayesian optimisation, and reinforcement learning.

    “It is also used to guide methods that require exploration like active learning [53], continual learning [92], Bayesian optimisation [47], and reinforcement learning [58].”

    From Uncertainty as a Form of Transparency: Measuring, Communicating, and Using Uncertainty (2021) · cites this paper as [47]

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Flagged first, then by citations

Research works printed but not linked: 24

  1. [1][1] I. Ahmad and P.-E. Lin. A nonparametric estimation of the entropy for absolutely continuous distributions. IEEE Transactions on Information Theory , 22(3):372-375, 1976. -
  2. [2][2] B. S. Anderson, A. W. Moore, and D. Cohn. A nonparametric approach to noisy and costly optimization. In ICML , pages 17-24, 2000. -
  3. [4][4] S. Bochner. Lectures on Fourier integrals . Princeton University Press, 1959. -
  4. [5][5] E. Brochu, V. M. Cora, and N. de Freitas. A tutorial on Bayesian optimization of expensive cost functions, with application to active user modeling and hierarchical reinforcement learning. Technical Report UBC TR-2009-23 and arXiv:1012.2599v1, Dept. of Computer Science, University of British Columbia, 2009. - · arXiv
  5. [6][6] E. Brochu, N. de Freitas, and A. Ghosh. Active preference learning with discrete choice data. In NIPS , pages 409-416, 2007. -
  6. [7][7] E. H. Burrows, W.-K. Wong, X. Fern, F. W. R. Chaplen, and R. L. Ely. Optimization of ph and nitrogen for enhanced hydrogen production by synechocystis sp. pcc 6803 via statistical and machine learning methods. Biotechnology Progress , 25(4):1009-1017, 2009. -
  7. [8][8] O. Chapelle and L. Li. An empirical evaluation of Thompson sampling. In NIPS , pages 2249-2257, 2011. -
  8. [9][9] P. Hennig and C. J. Schuler. Entropy search for information-efficient global optimization. Journal of Machine Learning Research , 13, 2012. -
  9. [10][10] M. W. Hoffman, E. Brochu, and N. de Freitas. Portfolio allocation for Bayesian optimization. In UAI , pages 327-336, 2011. -
  10. [11][11] N. Houlsby, J. M. Hern´ andez-lobato, F. Huszar, and Z. Ghahramani. Collaborative gaussian processes for preference learning. In NIPS , pages 2096-2104. 2012. -
  11. [12][12] E. Jondeau and M. Rockinger. The copula-garch model of conditional dependencies: An international stock market application. Journal of international money and finance , 25(5):827-853, 2006. -
  12. [14][14] H. Kushner. A new method of locating the maximum of an arbitrary multipeak curve in the presence of noise. Journal of Basic Engineering , 86, 1964. -
  13. [15][15] D. Lizotte. Practical Bayesian Optimization . PhD thesis, University of Alberta, Canada, 2008. -
  14. [16][16] D. Lizotte, T. Wang, M. Bowling, and D. Schuurmans. Automatic gait optimization with Gaussian process regression. In IJCAI , pages 944-949, 2007. -
  15. [17][17] D. J. MacKay. Information-based objective functions for active data selection. Neural Computation , 4(4):590-604, 1992. -
  16. [18][18] T. P. Minka. A family of algorithms for approximate Bayesian inference . PhD thesis, Massachusetts Institute of Technology, 2001. -
  17. [19][19] J. Moˇ ckus, V . Tiesis, and A. ˇ Zilinskas. The application of bayesian methods for seeking the extremum. In L. Dixon and G. Szego, editors, Toward Global Optimization , volume 2. Elsevier, 1978. -
  18. [20][20] D. M. Negoescu, P. I. Frazier, and W. B. Powell. The knowledge-gradient algorithm for sequencing experiments in drug discovery. INFORMS Journal on Computing , 23(3):346-363, 2011. -
  19. [21][21] A. Rahimi and B. Recht. Random features for large-scale kernel machines. In NIPS , pages 1177-1184, 2007. -
  20. [23][23] M. W. Seeger. Bayesian inference and optimal design for the sparse linear model. Journal of Machine Learning Research , 9:759-813, 2008. -
  21. [25][25] E. Solak, R. Murray-smith, W. E. Leithead, D. J. Leith, and C. E. Rasmussen. Derivative observations in gaussian process models of dynamic systems. In NIPS , pages 1057-1064. 2003. -
  22. [26][26] N. Srinivas, A. Krause, S. M. Kakade, and M. Seeger. Gaussian process optimization in the bandit setting: No regret and experimental design. In ICML , pages 1015-1022, 2010. -
  23. [27][27] J. Vanhatalo, J. Riihim¨ aki, J. Hartikainen, P. Jyl¨ anki, V. Tolvanen, and A. Vehtari. Bayesian modeling with gaussian processes using the matlab toolbox gpstuff (v3.3). CoRR , abs/1206.5754, 2012. - · arXiv
  24. [28][28] Z. Wang, S. Mohamed, and N. de Freitas. Adaptive Hamiltonian and Riemann Monte Carlo samplers. In ICML , 2013. -

Cited by

Sorted by citations

Metadata

Authors
Hernández-Lobato, J. M., Hoffman, M. W., & Ghahramani, Z.
Affiliations
University of Cambridge (GB)
ORCID
Hernández-Lobato, José Miguel
Venue
arXiv
Publisher
arXiv
Published
2014
Volume
27
Pages
918-926
ISSN
2331-8422 (ISSN-L)
DOI
10.48550/arxiv.1406.2541
arXiv
1406.2541
OpenAlex
W2167789032
Cited by
407
References
3
Citations by year
2026: 1 · 2025: 14 · 2024: 35 · 2023: 29 · 2022: 27 · 2021: 75 · 2020: 74 · 2019: 61 · 2018: 30 · 2017: 29 · 2016: 22 · 2015: 9 · 2014: 1
Type
posted content
Language
en
Open access
Licence
arxiv.org/licenses/nonexclusive-distrib/1.0/
Locations
  • arXiv (Cornell University) (submittedVersion)
  • Cambridge University Engineering Department Publications Database (submittedVersion)
  • arXiv (Cornell University)
Topics
  • Social Sciences › Decision Sciences › Management Science and Operations Research › Advanced Bandit Algorithms Research
  • Physical Sciences › Computer Science › Computational Theory and Mathematics › Advanced Multi-Objective Optimization Algorithms
  • Physical Sciences › Computer Science › Artificial Intelligence › Gaussian Processes and Bayesian Inference
Keywords
Bayesian optimization, black-box optimization, acquisition functions, information-theoretic optimization, differential entropy, global optimization

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review