The DOI matches its DataCite record; 14 of the 25 references it cites were found in a registry or an index.
Bayesian Active Learning for Classification and Preference Learning
Open accessAbstract
Information theoretic active learning has been widely studied for probabilistic models. For simple regression an optimal myopic policy is easily tractable. However, for other tasks and with more complex models, such as classification with nonparametric models, the optimal solution is harder to compute. Current approaches make approximations to achieve tractability. We propose an approach that expresses information gain in terms of predictive entropies, and apply this method to the Gaussian Process Classifier (GPC). Our approach makes minimal approximations to the full information theoretic objective. Our experimental performance compares favourably to many popular active learning algorithms, and has equal or lower computational complexity. We compare well to decision theoretic approaches also, which are privy to more information and require much more computational time. Secondly, by developing further a reformulation of binary preference learning to a classification problem, we extend our algorithm to Gaussian Process preference learning.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“It is also used to guide methods that require exploration like active learning [53], continual learning [92], Bayesian optimisation [47], and reinforcement learning [58].”
From Uncertainty as a Form of Transparency: Measuring, Communicating, and Using Uncertainty (2021) · cites this paper as [53]
The cited source says what the claim attributes to it.
In the citing paper
“The epistemic term I x is BALD's acquisition score [Houlsby et al., 2011]”
From Decomposing LLM-Judge Uncertainty to Target Expert Labels (2026) · cites this paper as Houlsby et al., 2011
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Gaussian Processes for Machine Learning
Rasmussen, C. E., & Williams, C. K. I. (2005) · doi:10.7551/mitpress/3206.001.0001 · Cited by 11,705
Seung, H., Opper, M., & Sompolinsky, H. (1992) · Annual Conference Computational Learning Theory · doi:10.1145/130385.130417 · Cited by 2,193 · cited 2×
“Perhaps the most ubiquitous is active learning for SVMs [Tong and Koller, 2001, Seung et al., 1992], where the volume of Version Space (VS) is used as a proxy for the posterior entropy.”
BackgroundMethodNear-optimal sensor placements in Gaussian processes
Guestrin, C., Krause, A., & Singh, A. (2005) · International Conference on Machine Learning · doi:10.1145/1102351.1102385 · Cited by 1,906 · cited 1×
“[Guestrin et al., 2005, Krause et al., 2006] also use mutual information.”
On a measure of the information provided by an experiment
Lindley, D. V. (1956) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177728069 · Cited by 1,509 · cited 2×
“Although the latter approach was proposed several decades ago [Lindley, 1956, Bernardo, 1979], it is not always straightforward to apply the criteria to complicated models such as nonparametric processes with infinite parameter spaces.”
BackgroundMethodInformation-based objective functions for active data selection
MacKay, D. J. C. (1992) · Neural Computation · doi:10.1162/neco.1992.4.4.590 · Cited by 1,221 · cited 2×
“We no longer need to build our entropy calculation around the type of posterior approximation (as in [MacKay, 1992, Krishnapuram et al., , Lawrence et al., 2003]) but are free to choose from many of the available algorithms.”
BackgroundMethodExpected Information as Expected Utility
Bernardo, J. (1979) · The Annals of Statistics · doi:10.1214/aos/1176344689 · Cited by 705 · cited 1×
“Although the latter approach was proposed several decades ago [Lindley, 1956, Bernardo, 1979], it is not always straightforward to apply the criteria to complicated models such as nonparametric processes with infinite parameter spaces.”
BackgroundPreference learning with Gaussian processes
Chu, W., & Ghahramani, Z. (2005) · International Conference on Machine Learning · doi:10.1145/1102351.1102369 · Cited by 504 · cited 4×
“Our active learning framework for GPC can be extended to the important problem of preference learning [F¨urnkranz and H¨ullermeier, 2003, Chu and Ghahramani, 2005].”
BackgroundMethodInfluentialSelf-citationNear-optimal sensor placements: maximizing information while minimizing communication cost
Krause, A., Guestrin, C., Gupta, A., & Kleinberg, J. (2006) · 2006 5th International Conference on Information Processing in Sensor Networks · doi:10.1145/1127777.1127782 · Cited by 489 · cited 1×
“[Guestrin et al., 2005, Krause et al., 2006] also use mutual information.”
BackgroundPairwise Preference Learning and Ranking
Fürnkranz, J., & Hüllermeier, E. (2003) · European Conference on Machine Learning · doi:10.1007/978-3-540-39857-8_15 · Cited by 295 · cited 1×
“Our active learning framework for GPC can be extended to the important problem of preference learning [F¨urnkranz and H¨ullermeier, 2003, Chu and Ghahramani, 2005].”
MethodMaximum entropy sampling and optimal bayesian experimental design
Sebastiani, P., & Wynn, H. P. (2000) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/1467-9868.00225 · Cited by 243 · cited 1×
“Information Theoretic approaches: Maximum Entropy Sampling (MES) [Sebastiani and Wynn, 2000] explicitly works in dataspace (Eqn.”
MethodInferring Spike Trains From Local Field Potentials
Rasch, M. J., Gretton, A., Murayama, Y., Maass, W., & Logothetis, N. K. (2007) · Journal of Neurophysiology · doi:10.1152/jn.00919.2007 · Cited by 217 · cited 1×
“…parameter space (exponentially hard with dimensionality), or sampling (from which it is notoriously hard to estimate entropies without introducing bias [Panzeri and Petersen, 2007]), these papers make Gaussian or low dimensional approximations and calculate the entropy of the approximate posterior.”
BackgroundMaximum Mutual Information Principle for Dynamic Sensor Query Problems
Ertin, E., Fisher, J. W., III, & Potter, L. (2003) · International Symposium on Information Processing in Sensor Networks · doi:10.1007/3-540-36978-3_27 · Cited by 177
Semi-Supervised Classification
Topor, R., Salem, K., Gupta, A., Goda, K., Gehrke, J., Palmer, N., Sharaf, M., Labrinidis, A., Roddick, J., Fuxman, A., et al. (2009) · Encyclopedia of Database Systems · doi:10.1007/978-0-387-39940-9_3578 · Cited by 157
Adaptive Submodularity: A New Approach to Active Learning and Stochastic OptimizationPreprint
Golovin, D., & Krause, A. (2010) · Annual Conference Computational Learning Theory · doi:10.48550/arxiv.1003.3967 · Cited by 139
Cited by
Sorted by citations
A review of uncertainty quantification in deep learning: Techniques, applications and challenges
Abdar, M., Pourpanah, F., Hussain, S., Rezazadegan, D., Liu, L., Ghavamzadeh, M., Fieguth, P., Cao, X., Khosravi, A., Acharya, U. R., et al. (2021) · Information Fusion · doi:10.1016/j.inffus.2021.05.008 · Cited by 3,111
A Survey of Deep Active Learning
Ren, P., Xiao, Y., Chang, X., Huang, P.-Y., Li, Z., Gupta, B. B., Chen, X., & Wang, X. (2022) · ACM Computing Surveys · doi:10.1145/3472291 · Cited by 1,169
“For its part, BatchBALD [84] opts to expand BALD [67] to the batch query context; this approach no longer calculates the mutual information between a single sample and model parameters, but rather recalculates the mutual information between the batch samples and the model parameters to jointly score the batch of sampl…”
BackgroundMethodInfluentialDeep Bayesian Active Learning with Image Data
Gal, Y., Islam, R., & Ghahramani, Z. (2017) · arXiv · doi:10.48550/arxiv.1703.02910 · Cited by 900
Self-citationBatchBALD: Efficient and Diverse Batch Acquisition for Deep Bayesian Active LearningPreprint
Kirsch, A., van Amersfoort, J. R., & Gal, Y. (2019) · Neural Information Processing Systems · doi:10.48550/arxiv.1906.08158 · Cited by 826
The Power of Ensembles for Active Learning in Image Classification
Beluch, W. H., Genewein, T., Nurnberger, A., & Kohler, J. M. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00976 · Cited by 655
“Another measure (also known as (BALD, [27]) is the mutual information between data-points and weights.”
Background
Metadata
- Authors
- Houlsby, N., Huszár, F., Ghahramani, Z., & Lengyel, M.
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2011
- arXiv
- 1112.5745
- OpenAlex
- W1872312298
- Cited by
- 507
- References
- 25
- Citations by year
- 2026: 4 · 2025: 35 · 2024: 62 · 2023: 86 · 2022: 54 · 2021: 111 · 2020: 64 · 2019: 40 · 2018: 20 · 2017: 11 · 2016: 3 · 2015: 5 · 2014: 7 · 2013: 4 · 2012: 1
- FWCI
- 1.55
- Type
- book
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- Cambridge University Engineering Department Publications Database (acceptedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning and Algorithms
- Physical Sciences › Computer Science › Artificial Intelligence › Gaussian Processes and Bayesian Inference
- Social Sciences › Decision Sciences › Management Science and Operations Research › Advanced Bandit Algorithms Research
- Keywords
- Bayesian active learning, information gain, predictive entropy, Gaussian process classifier, preference learning, classification, nonparametric models
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
