The DOI matches its DataCite record; 23 of the 23 references it cites were found in a registry or an index.
Practical Bayesian Optimization of Machine Learning Algorithms
Open accessAbstract
Machine learning algorithms frequently require careful tuning of model hyperparameters, regularization terms, and optimization parameters. Unfortunately, this tuning is often a "black art" that requires expert experience, unwritten rules of thumb, or sometimes brute-force search. Much more appealing is the idea of developing automatic approaches which can optimize the performance of a given learning algorithm to the task at hand. In this work, we consider the automatic tuning problem within the framework of Bayesian optimization, in which a learning algorithm's generalization performance is modeled as a sample from a Gaussian process (GP). The tractable posterior distribution induced by the GP leads to efficient use of the information gathered by previous experiments, enabling optimal choices about what parameters to try next. Here we show how the effects of the Gaussian process prior and the associated inference procedure can have a large impact on the success or failure of Bayesian optimization. We show that thoughtful choices can lead to results that exceed expert-level performance in tuning machine learning algorithms. We also describe new algorithms that take into account the variable cost (duration) of learning experiments and that can leverage the presence of multiple cores for parallel experimentation. We show that these proposed algorithms improve on previous automatic procedures and can reach or surpass human expert-level optimization on a diverse set of contemporary algorithms including latent Dirichlet allocation, structured SVMs and convolutional neural networks.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“Validation accuracy can also guide hyperparameter and architecture search (Snoek et al., 2012;Zoph & Le, 2017); both uses reduce the validation set to a single number.”
From VERSE: Verified Self-Evolving Optimizer for Agent Harnesses (2026) · cites this paper as Snoek et al., 2012
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Learning Multiple Layers of Features from Tiny Images
Krizhevsky, A. (2024) · doi:10.57702/zp44cu3g · Cited by 23,889
Gaussian Processes for Machine Learning
Rasmussen, C. E., & Williams, C. K. I. (2005) · doi:10.7551/mitpress/3206.001.0001 · Cited by 11,705
(2012) · Cited by 8,009
Bayesian calibration of computer models
Kennedy, M. C., & O'Hagan, A. (2001) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/1467-9868.00294 · Cited by 4,222
(2011) · Cited by 3,939
Multi-column deep neural networks for image classification
Ciresan, D. C., Meier, U., & Schmidhuber, J. (2012) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2012.6248110 · Cited by 3,880
Brochu, E., Cora, V. M., & de Freitas, N. (2010) · arXiv (Cornell University) · doi:10.48550/arxiv.1012.2599 · Cited by 2,568
Sequential Model-Based Optimization for General Algorithm Configuration
Hutter, F., Hoos, H. H., & Leyton-Brown, K. (2011) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-25566-3_40 · Cited by 2,469
A Taxonomy of Global Optimization Methods Based on Response Surfaces
Jones, D. R. (2001) · Journal of Global Optimization · doi:10.1023/a:1012771025575 · Cited by 2,160
Information-Theoretic Regret Bounds for Gaussian Process Optimization in the Bandit Setting
Srinivas, N., Krause, A., Kakade, S. M., & Seeger, M. (2012) · IEEE Transactions on Information Theory · doi:10.48550/arxiv.0912.3995 · Cited by 2,100
Research works printed but not linked: 2
- Niranjan Srinivas, Andreas Krause, Sham Kakade, and Matthias Seeger. Gaussian process optimization in the bandit setting: No regret and experimental design. In ICML , 2010.
- Kevin Miller, M. Pawan Kumar, Benjamin Packer, Danny Goodman, and Daphne Koller. Max-margin minentropy models. In AISTATS , 2012.
Cited by
Sorted by citations
Items 201–300 of 1,026
Colloquium : Machine learning in nuclear physics
Boehnlein, A., Diefenthaler, M., Sato, N., Schram, M., Ziegler, V., Fanelli, C., Hjorth-Jensen, M., Horn, T., Kuchera, M., Lee, D., et al. (2022) · Reviews of Modern Physics · doi:10.1103/revmodphys.94.031003 · Cited by 287
Carbontracker: Tracking and Predicting the Carbon Footprint of Training Deep Learning Models
Anthony, L. F. W., Kanding, B., & Selvan, R. (2020) · arXiv · doi:10.48550/arxiv.2007.03051 · Cited by 255
“Hyperparameter tuning may be improved by substituting grid search for random search (Bergstra & Bengio, 2012), using Bayesian optimization (Snoek et al., 2012) or other optimization techniques like Hyperband (Li et al., 2017).”
MethodTaking Human out of Learning Applications: A Survey on Automated Machine LearningPreprint
Yao, Q., Wang, M., Escalante, H. J., Guyon, I., Hu, Y.-Q., Li, Y., Tu, W.-W., Yang, Q., & Yang, Y. (2018) · arXiv (Cornell University) · Cited by 261
AdaCos: Adaptively Scaling Cosine Logits for Effectively Learning Deep Face Representations
Zhang, X., Zhao, R., Qiao, Y., Wang, X., & Li, H. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.01108 · Cited by 250
Artificial Intelligence in manufacturing: State of the art, perspectives, and future directions
Gao, R. X., Krüger, J., Merklein, M., Möhring, H., & Váncza, J. (2024) · CIRP Annals · doi:10.1016/j.cirp.2024.04.101 · Cited by 302
Optimal Hyperparameters for Deep LSTM-Networks for Sequence Labeling Tasks
Reimers, N., & Gurevych, I. (2017) · arXiv · doi:10.48550/arxiv.1707.06799
Tensor Comprehensions: Framework-Agnostic High-Performance Machine Learning AbstractionsPreprint
Vasilache, N., Zinenko, O., Theodoridis, T., Goyal, P., DeVito, Z., Moses, W. S., Verdoolaege, S., Adams, A., & Cohen, A. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1802.04730 · Cited by 467
Jet substructure classification in high-energy physics with deep neural networks
Baldi, P., Bauer, K., Eng, C. H., Sadowski, P., & Whiteson, D. (2016) · Physical review. D/Physical review. D. · doi:10.1103/physrevd.93.094034 · Cited by 249
Martínez-Cantín, R. (2014) · Zaguan (Universidad de Zaragoza) · doi:10.48550/arxiv.1405.7430 · Cited by 248
Ayala Solares, J. R., Diletta Raimondi, F. E., Zhu, Y., Rahimian, F., Canoy, D., Tran, J., Pinho Gomes, A. C., Payberah, A. H., Zottoli, M., Nazarzadeh, M., et al. (2020) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2019.103337 · Cited by 247
Neural Additive Models: Interpretable Machine Learning with Neural NetsPreprint
Agarwal, R., Melnick, L., Frosst, N., Zhang, X., Lengerich, B. J., Caruana, R., & Hinton, G. E. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2004.13912 · Cited by 317
Lin, M., Chen, Q., & Yan, S. (2013) · arXiv · doi:10.48550/arxiv.1312.4400 · Cited by 252
Deep learning in wastewater treatment: a critical review
Alvi, M., Batstone, D. J., Mbamba, C. K., Keymer, P. C., French, T., Ward, A. J., Dwyer, J., & Cardell‐Oliver, R. (2023) · Water Research · doi:10.1016/j.watres.2023.120518 · Cited by 262
Data, M. C. (2020) · OAPEN (The OAPEN Foundation) · doi:10.1007/978-3-319-43742-2 · Cited by 273
Expected improvement for expensive optimization: a review
Zhan, D., & Xing, H. (2020) · Journal of Global Optimization · doi:10.1007/s10898-020-00923-x · Cited by 246
Short-term load forecasting of industrial customers based on SVMD and XGBoost
Wang, Y., Sun, S., Chen, X., Zeng, X., Kong, Y., Chen, J., Guo, Y., & Wang, T. (2021) · International Journal of Electrical Power & Energy Systems · doi:10.1016/j.ijepes.2021.106830 · Cited by 245
Multi-Objective Loss Balancing for Physics-Informed Deep Learning
Bischof, R., & Kraus, M. A. (2025) · Computer Methods in Applied Mechanics and Engineering · doi:10.1016/j.cma.2025.117914 · Cited by 245
Bayesian optimization in high dimensions via random embeddings
Wang, Z., Zoghi, M., Hutter, F., Matheson, D. S., & de Freitas, N. (2013) · UvA-DARE (University of Amsterdam) · Cited by 256
AuDI: Toward Autonomous IoT Device-Type Identification Using Periodic Communication
Marchal, S., Miettinen, M., Nguyen, T. D., Sadeghi, A., & Asokan, N. (2019) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2019.2904364 · Cited by 242
Abdar, M., Samami, M., Mahmoodabad, S. D., Doan, T., Mazoure, B., Hashemifesharaki, R., Liu, L., Khosravi, A., Acharya, U. R., Makarenkov, V., et al. (2021) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2021.104418 · Cited by 245
Deep reinforcement learning for inventory control: A roadmap
Boute, R. N., Gijsbrechts, J., van Jaarsveld, W. L., & Vanvuchelen, N. (2021) · European Journal of Operational Research · doi:10.1016/j.ejor.2021.07.016 · Cited by 275
Advanced hyperparameter optimization of deep learning models for wind power prediction
Hanifi, S., Cammarano, A., & Zare‐Behtash, H. (2023) · Renewable Energy · doi:10.1016/j.renene.2023.119700 · Cited by 237
Tufail, S., Riggs, H., Tariq, M., & Sarwat, A. I. (2023) · Electronics · doi:10.3390/electronics12081789 · Cited by 267
Learning to Optimize Tensor ProgramsPreprint
Chen, T., Zheng, L., Yan, E., Jiang, Z., Moreau, T., Ceze, L., Guestrin, C., & Krishnamurthy, A. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1805.08166 · Cited by 280
Representation Learning: A Review and New PerspectivesPreprint
Bengio, Y., Courville, A. C., & Vincent, P. (2012) · arXiv (Cornell University) · doi:10.48550/arxiv.1206.5538 · Cited by 235
Predicting clinical outcomes from large scale cancer genomic profiles with deep survival models
Yousefi, S., Amrollahi, F., Amgad, M. T., Dong, C., Lewis, J. E., Song, C., Gutman, D. A., Halani, S. H., Vega, J. E. V., Brat, D. J., et al. (2017) · Scientific Reports · doi:10.1038/s41598-017-11817-6 · Cited by 243
Zhang, B., Jin, X., Ratnasamy, S., Wawrzynek, J., & Lee, E. A. (2018) · ACM SIGCOMM Conference (SIGCOMM) · doi:10.1145/3230543.3230554 · Cited by 236
CMA-ES for Hyperparameter Optimization of Deep Neural NetworksPreprint
Loshchilov, I., & Hutter, F. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1604.07269 · Cited by 228
Liang, Q., Gongora, A. E., Ren, Z., Tiihonen, A., Liu, Z., Sun, S., Deneault, J. R., Bash, D., Mekki‐Berrada, F., Khan, S. A., et al. (2021) · npj Computational Materials · doi:10.1038/s41524-021-00656-9 · Cited by 250
True Few-Shot Learning with Language Models
Perez, E., Kiela, D., & Cho, K. (2021) · arXiv · doi:10.48550/arxiv.2105.11447 · Cited by 226
A Taxonomy of Deep Convolutional Neural Nets for Computer Vision
Srinivas, S., Sarvadevabhatla, R. K., Mopuri, K. R., Prabhu, N., Kruthiventi, S. S. S., & Babu, R. V. (2016) · Frontiers in Robotics and AI · doi:10.3389/frobt.2015.00036 · Cited by 244
LSTM-MSNet: Leveraging Forecasts on Sets of Related Time Series With Multiple Seasonal Patterns
Bandara, K., Bergmeir, C., & Hewamalage, H. (2020) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2020.2985720 · Cited by 224
He, X., Yang, H., Hu, Z., & Lv, C. (2022) · IEEE Transactions on Intelligent Vehicles · doi:10.1109/tiv.2022.3165178 · Cited by 230
Toward Deep Learning Software Repositories
White, M., Vendome, C., Linares‐Vásquez, M., & Poshyvanyk, D. (2015) · International Conference on Mining Software Repositories (MSR) · doi:10.1109/msr.2015.38 · Cited by 222
Forecasting Corn Yield with Machine Learning Ensembles
Shahhosseini, M., Hu, G., & Archontoulis, S. V. (2020) · Iowa State University Digital Repository (Iowa State University) · Cited by 221
ReNet: A Recurrent Neural Network Based Alternative to Convolutional NetworksPreprint
Visin, F., Kastner, K., Cho, K., Matteucci, M., Courville, A. C., & Bengio, Y. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1505.00393 · Cited by 285
Federated Collaborative Filtering for Privacy-Preserving Personalized Recommendation SystemPreprint
Ammad-ud-din, M., Ivannikova, E., Khan, S. A., Oyomno, W., Fu, Q., Tan, K. E., & Flanagan, A. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1901.09888 · Cited by 464
Dynamical Hyperparameter Optimization via Deep Reinforcement Learning in Tracking
Dong, X., Shen, J., Wang, W., Shao, L., Ling, H., & Porikli, F. (2019) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2019.2956703 · Cited by 223
Zhang, Y., Sohn, K., Villegas, R., Pan, G., & Lee, H. (2015) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2015.7298621 · Cited by 225
Jiao, W., Atwal, G., Polak, P. P., Karlić, R., Cuppen, E. P. J. G., Al‐Shahrour, F., Atwal, G., Bailey, P. J., Biankin, A. V., Boutros, P. C., et al. (2020) · Nature Communications · doi:10.1038/s41467-019-13825-8 · Cited by 223
What to Do When K-Means Clustering Fails: A Simple yet Principled Alternative Algorithm
Raykov, Y. P., Boukouvalas, A., Baig, F., & Little, M. A. (2016) · PLoS ONE · doi:10.1371/journal.pone.0162259 · Cited by 217
Multi-task Neural Networks for QSAR PredictionsPreprint
Dahl, G. E., Jaitly, N., & Salakhutdinov, R. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1406.1231 · Cited by 352
Bayesian Optimization for Likelihood-Free Inference of Simulator-Based Statistical ModelsPreprint
Gutmann, M. U., & Corander, J. (2015) · arXiv (Cornell University) · doi:10.5555/2946645.3007078 · Cited by 217
SentiCap: Generating Image Descriptions with Sentiments
Mathews, A., Xie, L., & He, X. (2016) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v30i1.10475 · Cited by 219
Bootstrapping the out-of-sample predictions for efficient and accurate cross-validation
Tsamardinos, I., Greasidou, E., & Borboudakis, G. (2018) · Machine Learning · doi:10.1007/s10994-018-5714-4 · Cited by 230
Hramov, A. E., Александрович, М. В., & Pisarchik, A. N. (2021) · Physics Reports · doi:10.1016/j.physrep.2021.03.002 · Cited by 228
Hyperparameter Tuning in Machine Learning: A Comprehensive Review
Ilemobayo, J. A., Durodola, O. I., Alade, O., Awotunde, O. J., Olanrewaju, A. T., Falana, O., Ogungbire, A., Osinuga, A., Ogunbiyi, D., Ifeanyi, A. O., et al. (2024) · Journal of Engineering Research and Reports · doi:10.9734/jerr/2024/v26i61188 · Cited by 284
Beyond Manual Tuning of Hyperparameters
Hutter, F., Lücke, J., & Schmidt-Thieme, L. (2015) · Künstliche Intell. · doi:10.1007/s13218-015-0381-0 · Cited by 228
Wu, C., Pan, H., Luo, Z., Liu, C., & Huang, H. (2024) · Building and Environment · doi:10.1016/j.buildenv.2024.111386 · Cited by 209
A Survey on Neural Architecture SearchPreprint
Wistuba, M., Rawat, A., & Pedapati, T. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1905.01392 · Cited by 358
An effective algorithm for hyperparameter optimization of neural networks
Diaz, G. I., Fokoue, A., Nannicini, G., & Samulowitz, H. (2017) · IBM Journal of Research and Development · doi:10.1147/jrd.2017.2709578 · Cited by 208
Optimizing ensemble weights and hyperparameters of machine learning models for regression problems
Shahhosseini, M., Hu, G., & Pham, H. (2022) · Machine Learning with Applications · doi:10.1016/j.mlwa.2022.100251 · Cited by 235
Random Forest Classification for Detecting Android Malware
Alam, M. S., & Vuong, S. T. (2013) · IEEE International Conference on Internet of Things (iThings) and IEEE Green Computing and Communications (GreenCom) and IEEE Cyber, Physical and Social Computing (CPSCom) and IEEE Smart Data (SmartData) · doi:10.1109/greencom-ithings-cpscom.2013.122 · Cited by 214
Prediction and analysis of train arrival delay based on XGBoost and Bayesian optimization
Shi, R., Xu, X., Li, J., & Li, Y. (2021) · Applied Soft Computing · doi:10.1016/j.asoc.2021.107538 · Cited by 207
Demystifying Parallel and Distributed Deep Learning: An In-Depth Concurrency AnalysisPreprint
Ben‐Nun, T., & Hoefler, T. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1802.09941 · Cited by 204
Towards a fully automated algorithm driven platform for biosystems design
HamediRad, M., Chao, R., Weisberg, S., Lian, J., Sinha, S., & Zhao, H. (2019) · Nature Communications · doi:10.1038/s41467-019-13189-z · Cited by 214
Lee, J.-W., Park, W. B., Lee, J. H., Singh, S. P., & Sohn, K. (2020) · Nature Communications · doi:10.1038/s41467-019-13749-3 · Cited by 219
An artificial agent for robust image registration
Liao, R., Miao, S., De Tournemire, P., Grbic, S., Kamen, A., Mansi, T., & Comaniciu, D. (2017) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v31i1.11230 · Cited by 199
Online Batch Selection for Faster Training of Neural NetworksPreprint
Loshchilov, I., & Hutter, F. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1511.06343 · Cited by 314
Chiarelli, A. M., Croce, P., Merla, A., & Zappasodi, F. (2018) · Journal of Neural Engineering · doi:10.1088/1741-2552/aaaf82 · Cited by 210
Rahman, A. T. M. S., Hosono, T., Quilty, J., Das, J., & Basak, A. (2020) · Advances in Water Resources · doi:10.1016/j.advwatres.2020.103595 · Cited by 199
Li, C., Zhi, D., Wang, K., & Liu, X. (2022) · Genome Medicine · doi:10.1186/s13073-022-01120-z · Cited by 202
SMAC3: A Versatile Bayesian Optimization Package for Hyperparameter Optimization
Lindauer, M., Eggensperger, K., Feurer, M., Biedenkapp, A., Deng, D., Benjamins, C., Ruhopf, T., Sass, R., & Hutter, F. (2021) · arXiv · doi:10.48550/arxiv.2109.09831 · Cited by 195
Deep learning approach to bacterial colony classification
Zieliński, B., Plichta, A., Misztal, K., Spurek, P., Brzychczy‐Włoch, M., & Ochońska, D. (2017) · PLoS ONE · doi:10.1371/journal.pone.0184554 · Cited by 208
Machine learning the Hubbard U parameter in DFT+U using Bayesian optimization
Yu, M., Yang, S., Wu, C., & Marom, N. (2020) · npj Computational Materials · doi:10.1038/s41524-020-00446-9 · Cited by 203
Virtual screening of inorganic materials synthesis parameters with deep learning
Kim, E., Huang, K., Jegelka, S., & Olivetti, E. (2017) · npj Computational Materials · doi:10.1038/s41524-017-0055-6 · Cited by 190
Artificial intelligence for satellite communication: A review
Fourati, F., & Alouini, M. (2021) · Intelligent and Converged Networks · doi:10.23919/icn.2021.0015 · Cited by 197
Aerial Visual Perception in Smart Farming: Field Study of Wheat Yellow Rust Monitoring
Su, J., Yi, D., Su, B., Mi, Z., Liu, C., Hu, X., Xu, X., Guo, L., & Chen, W. (2020) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2020.2979237 · Cited by 194
Bayesian Optimization for Accelerating Hyper-Parameter Tuning
Nguyen, V. (2019) · IEEE International Conference on Artificial Intelligence and Knowledge Engineering (AIKE) · doi:10.1109/aike.2019.00060 · Cited by 191
Simple And Efficient Architecture Search for Convolutional Neural NetworksPreprint
Elsken, T., Metzen, J. H., & Hutter, F. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1711.04528 · Cited by 190
On Empirical Comparisons of Optimizers for Deep LearningPreprint
Choi, D., Shallue, C. J., Nado, Z., Lee, J., Maddison, C. J., & Dahl, G. E. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1910.05446 · Cited by 362
Using Random forest and Gradient boosting trees to improve wave forecast at a specific location
Callens, A., Morichon, D., Abadie, S., Delpey, M. T., & Liquet, B. (2020) · Applied Ocean Research · doi:10.1016/j.apor.2020.102339 · Cited by 189
Luo, X., & Oyedele, L. O. (2021) · Advanced Engineering Informatics · doi:10.1016/j.aei.2021.101357 · Cited by 191
Aghighi, H., Azadbakht, M., Ashourloo, D., Shahrabi, H. S., & Radiom, S. (2018) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2018.2823361 · Cited by 187
Tackling climate change with machine learning
Rolnick, D., Donti, P. L., Kaack, L. H., Kochanski, K., Lacoste, A., Sankaran, K., Ross, A. S., Milojevic-Dupont, N., Jaques, N., Waldman-Brown, A., et al. (2023) · ACM Computing Surveys · doi:10.1145/3485128 · Cited by 336
A deep learning enabler for nonintrusive reduced order modeling of fluid flows
Pawar, S. A., Rahman, S. M., Vaddireddy, H., San, O., Rasheed, A., & Vedula, P. (2019) · Physics of Fluids · doi:10.1063/1.5113494 · Cited by 183
Jörges, C., Berkenbrink, C., & Stumpe, B. (2021) · Ocean Engineering · doi:10.1016/j.oceaneng.2021.109046 · Cited by 192
Liu, S., Chen, P., Kailkhura, B., Zhang, G., Hero, A. O., & Varshney, P. K. (2020) · IEEE Signal Processing Magazine · doi:10.1109/msp.2020.3003837 · Cited by 235
The parameter sensitivity of random forests
Huang, B., & Boutros, P. C. (2016) · BMC Bioinformatics · doi:10.1186/s12859-016-1228-x · Cited by 201
Park, C., Ha, J., & Park, S. (2020) · Expert Systems with Applications · doi:10.1016/j.eswa.2019.112873 · Cited by 184
Nguyen, H.-P., Liu, J., & Zio, E. (2020) · Applied Soft Computing · doi:10.1016/j.asoc.2020.106116 · Cited by 184
Tang, S., Zhu, Y., & Yuan, S. (2022) · ISA Transactions · doi:10.1016/j.isatra.2022.01.013 · Cited by 189
AdaNet: Adaptive Structural Learning of Artificial Neural NetworksPreprint
Cortes, C., Gonzalvo, X., Kuznetsov, V., Mohri, M., & Yang, S. C. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1607.01097 · Cited by 182
Federated Learning with Buffered Asynchronous AggregationPreprint
Nguyen, J., Malik, K., Zhan, H., Yousefpour, A., Rabbat, M., Esmaeili, M. M., & Huba, D. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.06639 · Cited by 182
On-Demand Deep Model Compression for Mobile Devices: A Usage-Driven Model Selection Framework
Liu, S., Lin, Y., Zhou, Z., Nan, K., Liu, H., & Du, J. (2018) · Proceedings of the 16th Annual International Conference on Mobile Systems, Applications, and Services · doi:10.1145/3210240.3210337 · Cited by 217
Machine learning dihydrogen activation in the chemical space surrounding Vaska's complex
Friederich, P., dos Passos Gomes, G., De Bin, R., Aspuru-Guzik, A., & Balcells, D. (2020) · Chemical Science · doi:10.1039/d0sc00445f · Cited by 179
“In this work, we used a strategy pioneered by Adams et al. 120 based on Bayesian optimization to determine the optimal hyper-parameter values e ffi ciently (see Fig.”
Identifying Autism Spectrum Disorder From Resting-State fMRI Using Deep Belief Network
Huang, Z.-A., Zhu, Z., Yau, C. H., & Tan, K. C. (2020) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2020.3007943 · Cited by 189
Dataset Condensation with Gradient MatchingPreprint
Zhao, B., Mopuri, K. R., & Bilen, H. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.05929 · Cited by 382
Lv, Z., Wang, L., Han, Z., Zhao, J., & Wang, W. (2019) · IEEE/CAA Journal of Automatica Sinica · doi:10.1109/jas.2019.1911450 · Cited by 179
Hyperparameter optimization in learning systems
Andonie, R. (2019) · Journal of Membrane Computing · doi:10.1007/s41965-019-00023-0 · Cited by 190
Attack Graph Model for Cyber-Physical Power Systems Using Hybrid Deep Learning
Presekal, A., Stefanov, A. I., Rajkumar, V. S., & Pálenský, P. (2023) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2023.3237011 · Cited by 189
Daily retail demand forecasting using machine learning with emphasis on calendric special days
Huber, J., & Stuckenschmidt, H. (2020) · International Journal of Forecasting · doi:10.1016/j.ijforecast.2020.02.005 · Cited by 217
Bayesian optimisation for Intelligent Environmental Monitoring
Marchant, R., & Ramos, F. T. (2012) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2012.6385653 · Cited by 177
Toward deep learning software repositories
White, M., Vendome, C., & Poshyvanyk, D. (2015) · Cited by 190
Lujan-Moreno, G. A., Howard, P., Rojas, O., & Montgomery, D. C. (2018) · Expert Systems with Applications · doi:10.1016/j.eswa.2018.05.024 · Cited by 177
Pantheon: the training ground for internet congestion-control research
Yan, F. Y., Ma, J., Hill, G. D., Raghavan, D., Wahby, R. S., Levis, P. A., & Winstein, K. (2018) · USENIX Annual Technical Conference · Cited by 179
Putatunda, S., & Rama, K. (2018) · doi:10.1145/3297067.3297080 · Cited by 177
Multi-class Alzheimer's disease classification using image and clinical features
Altaf, T., Anwar, S. M., Gul, N., Majeed, M. N., & Majid, M. (2018) · Biomedical Signal Processing and Control · doi:10.1016/j.bspc.2018.02.019 · Cited by 179
Häse, F., Aldeghi, M., Hickman, R. J., Roch, L. M., & Aspuru‐Guzik, A. (2021) · Applied Physics Reviews · doi:10.1063/5.0048164 · Cited by 212
Bayesian optimization for chemical products and functional materials
Wang, K., & Dowling, A. W. (2021) · Current Opinion in Chemical Engineering · doi:10.1016/j.coche.2021.100728 · Cited by 196
Metadata
- Authors
- Snoek, J., Larochelle, H., & Adams, R. P.
- Affiliations
- University of Toronto (CA)
- Université de Sherbrooke (CA)
- Harvard University (US)
- ORCID
- Adams, Ryan P.
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2012
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1206.2944
- OpenAlex
- W2131241448
- Cited by
- 6,691
- References
- 23
- Citations by year
- 2026: 62 · 2025: 630 · 2024: 779 · 2023: 712 · 2022: 720 · 2021: 997 · 2020: 864 · 2019: 680 · 2018: 465 · 2017: 289 · 2016: 212 · 2015: 144 · 2014: 94 · 2013: 34 · 2012: 9
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- Digital Access to Scholarship at Harvard (DASH) (Harvard University) (submittedVersion, cc-by)
- arXiv (Cornell University)
- Funders
- Defense Advanced Research Projects Agency
- Natural Sciences and Engineering Research Council of Canada
- Topics
- Social Sciences › Decision Sciences › Management Science and Operations Research › Advanced Bandit Algorithms Research
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning and Data Classification
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning and Algorithms
- Keywords
- Bayesian optimization, hyperparameter optimization, Gaussian process priors, latent Dirichlet allocation, structured support vector machines, convolutional neural networks
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
