The DOI matches its DataCite record; 23 of the 23 references it cites were found in a registry or an index.
Practical Bayesian Optimization of Machine Learning Algorithms
Open accessAbstract
Machine learning algorithms frequently require careful tuning of model hyperparameters, regularization terms, and optimization parameters. Unfortunately, this tuning is often a "black art" that requires expert experience, unwritten rules of thumb, or sometimes brute-force search. Much more appealing is the idea of developing automatic approaches which can optimize the performance of a given learning algorithm to the task at hand. In this work, we consider the automatic tuning problem within the framework of Bayesian optimization, in which a learning algorithm's generalization performance is modeled as a sample from a Gaussian process (GP). The tractable posterior distribution induced by the GP leads to efficient use of the information gathered by previous experiments, enabling optimal choices about what parameters to try next. Here we show how the effects of the Gaussian process prior and the associated inference procedure can have a large impact on the success or failure of Bayesian optimization. We show that thoughtful choices can lead to results that exceed expert-level performance in tuning machine learning algorithms. We also describe new algorithms that take into account the variable cost (duration) of learning experiments and that can leverage the presence of multiple cores for parallel experimentation. We show that these proposed algorithms improve on previous automatic procedures and can reach or surpass human expert-level optimization on a diverse set of contemporary algorithms including latent Dirichlet allocation, structured SVMs and convolutional neural networks.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“Validation accuracy can also guide hyperparameter and architecture search (Snoek et al., 2012;Zoph & Le, 2017); both uses reduce the validation set to a single number.”
From VERSE: Verified Self-Evolving Optimizer for Agent Harnesses (2026) · cites this paper as Snoek et al., 2012
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Learning Multiple Layers of Features from Tiny Images
Krizhevsky, A. (2024) · doi:10.57702/zp44cu3g · Cited by 23,889
Gaussian Processes for Machine Learning
Rasmussen, C. E., & Williams, C. K. I. (2005) · doi:10.7551/mitpress/3206.001.0001 · Cited by 11,705
(2012) · Cited by 8,009
Bayesian calibration of computer models
Kennedy, M. C., & O'Hagan, A. (2001) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/1467-9868.00294 · Cited by 4,222
(2011) · Cited by 3,939
Multi-column deep neural networks for image classification
Ciresan, D. C., Meier, U., & Schmidhuber, J. (2012) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2012.6248110 · Cited by 3,880
Brochu, E., Cora, V. M., & de Freitas, N. (2010) · arXiv (Cornell University) · doi:10.48550/arxiv.1012.2599 · Cited by 2,568
Sequential Model-Based Optimization for General Algorithm Configuration
Hutter, F., Hoos, H. H., & Leyton-Brown, K. (2011) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-25566-3_40 · Cited by 2,469
A Taxonomy of Global Optimization Methods Based on Response Surfaces
Jones, D. R. (2001) · Journal of Global Optimization · doi:10.1023/a:1012771025575 · Cited by 2,160
Information-Theoretic Regret Bounds for Gaussian Process Optimization in the Bandit Setting
Srinivas, N., Krause, A., Kakade, S. M., & Seeger, M. (2012) · IEEE Transactions on Information Theory · doi:10.48550/arxiv.0912.3995 · Cited by 2,100
Research works printed but not linked: 2
- Niranjan Srinivas, Andreas Krause, Sham Kakade, and Matthias Seeger. Gaussian process optimization in the bandit setting: No regret and experimental design. In ICML , 2010.
- Kevin Miller, M. Pawan Kumar, Benjamin Packer, Danny Goodman, and Daphne Koller. Max-margin minentropy models. In AISTATS , 2012.
Cited by
Sorted by citations
Items 901–1,000 of 1,026
Identification of COPD From Multi-View Snapshots of 3D Lung Airway Tree via Deep CNN
Du, R., Qi, S., Feng, J., Xia, S., Kang, Y., Qian, W., & Yao, Y. (2020) · IEEE Access · doi:10.1109/access.2020.2974617 · Cited by 63
Robot control parameters auto-tuning in trajectory tracking applications
Roveda, L., Forgione, M., & Piga, D. (2020) · Control Engineering Practice · doi:10.1016/j.conengprac.2020.104488 · Cited by 63
ChemBO: Bayesian Optimization of Small Organic Molecules with Synthesizable RecommendationsPreprint
Korovina, K., Xu, S., Kandasamy, K., Neiswanger, W., Póczos, B., Schneider, J., & Xing, E. P. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1908.01425 · Cited by 74
Shakeout: A New Approach to Regularized Deep Neural Network Training
Kang, G., Li, J., & Tao, D. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2017.2701831 · Cited by 64
Kurth, T., Zhang, J., Nadathur, S., Racah, E., Mitliagkas, I., Patwary, M. M. A., Malas, T. B., Sundaram, N., Bhimji, W., Smorkalov, M. E., et al. (2017) · International Conference for High Performance Computing, Networking, Storage and Analysis (SC) · doi:10.1145/3126908.3126916 · Cited by 82
Wang, Q., Wu, D., Tin‐Loi, F., & Gao, W. (2019) · Thin-Walled Structures · doi:10.1016/j.tws.2019.106315 · Cited by 62
Reservoir computing model of two-dimensional turbulent convection
Pandey, S., & Schumacher, J. (2020) · Physical Review Fluids · doi:10.1103/physrevfluids.5.113506 · Cited by 63
Greenhouse gas emission prediction on road network using deep sequence learning
Alfaseeh, L., Tu, R., Farooq, B., & Hatzopoulou, M. (2020) · Transportation Research Part D Transport and Environment · doi:10.1016/j.trd.2020.102593 · Cited by 63
Hu, J., Huang, M.-C., & Yu, X. B. (2020) · Accident Analysis & Prevention · doi:10.1016/j.aap.2020.105665 · Cited by 66
Bonzanini, A. D., Paulson, J. A., Makrygiorgos, G., & Mesbah, A. (2020) · Computers & Chemical Engineering · doi:10.1016/j.compchemeng.2020.107174 · Cited by 62
Computational identification of eukaryotic promoters based on cascaded deep capsule neural networks
Zhu, Y. L., Li, F., Xiang, D., Akutsu, T., Song, J., & Jia, C. (2020) · Briefings in Bioinformatics · doi:10.1093/bib/bbaa299 · Cited by 62
DeepACSON automated segmentation of white matter in 3D electron microscopy
Abdollahzadeh, A., Belevich, I. N., Jokitalo, E., Sierra, A., & Tohka, J. (2021) · Communications Biology · doi:10.1038/s42003-021-01699-w · Cited by 67
Ward, I. R., Wang, L., Lü, J., Bennamoun, M., Dwivedi, G., & Sanfilippo, F. M. (2021) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2021.106415 · Cited by 70
Wang, H., Ji, C., Su, T., Shi, C., Ge, Y., Yang, J., & Wang, S. (2021) · Fuel · doi:10.1016/j.fuel.2021.122371 · Cited by 62
Application of transfer learning and image augmentation technology for tomato pest identification
Huang, M., Chuang, T.-C., & Liao, Y.-C. (2021) · Sustainable Computing Informatics and Systems · doi:10.1016/j.suscom.2021.100646 · Cited by 70
Jamil, M. A., & Khanam, S. (2023) · Journal of Vibration Engineering & Technologies · doi:10.1007/s42417-023-01036-x · Cited by 62
Bilevel Optimization with Nonsmooth Lower Level Problems
Ochs, P., Ranftl, R., Brox, T., & Pock, T. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-18461-6_52 · Cited by 62
Probabilistic Price Forecasting for Day-Ahead and Intraday Markets: Beyond the Statistical Model
Andrade, J., Filipe, J., Reis, M., & Bessa, R. J. (2017) · Sustainability · doi:10.3390/su9111990 · Cited by 62
On the automated, evolutionary design of neural networks: past, present, and future
Baldominos, A., Sáez, Y., & Isasi, P. (2019) · Neural Computing and Applications · doi:10.1007/s00521-019-04160-6 · Cited by 63
A System for Massively Parallel Hyperparameter TuningPreprint
Li, L., Jamieson, K., Rostamizadeh, A., Gonina, E., Hardt, M., Recht, B., & Talwalkar, A. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1810.05934 · Cited by 204
High-Dimensional Bayesian Optimization with Sparse Axis-Aligned SubspacesPreprint
Eriksson, D., & Jankowiak, M. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2103.00349 · Cited by 62
Chen, X., Duan, J., & Karniadakis, G. E. (2020) · European Journal of Applied Mathematics · doi:10.1017/s0956792520000169 · Cited by 61
Stieve, B. J., Richner, T. J., Krook-Magnuson, C., Netoff, T. I., & Krook-Magnuson, E. I. (2022) · Brain · doi:10.1093/brain/awac051 · Cited by 60
Park, U.-Y., Kang, Y., Lee, H., & Yun, S.-H. (2022) · Applied Sciences · doi:10.3390/app12199729 · Cited by 61
Nguyen, H. D., Long, N. H., Ha, K. N., Hoang, N. V., Hương, T. T., & Tran, K. P. (2023) · Computers in Industry · doi:10.1016/j.compind.2023.103888 · Cited by 61
The impact of Bayesian optimization on feature selection
Yang, K., Liu, L., & Wen, Y. (2024) · Scientific Reports · doi:10.1038/s41598-024-54515-w · Cited by 61
Bayesian geophysical inversion with trans-dimensional Gaussian process machine learning
Ray, A., & Myer, D. (2019) · Geophysical Journal International · doi:10.1093/gji/ggz111 · Cited by 61
Data Requirements for Applying Machine Learning to Energy Disaggregation
Shin, C., Rho, S., Lee, H., & Rhee, W. (2019) · Energies · doi:10.3390/en12091696 · Cited by 64
Role of deep learning in infant brain MRI analysis
Mostapha, M., & Styner, M. A. (2019) · Magnetic Resonance Imaging · doi:10.1016/j.mri.2019.06.009 · Cited by 63
Classification of Black Plastics Waste Using Fluorescence Imaging and Machine Learning
Gruber, F., Grählert, W., Wollmann, P., & Kaskel, S. (2019) · Recycling · doi:10.3390/recycling4040040 · Cited by 61
Parallel Bayesian Global Optimization of Expensive FunctionsPreprint
Wang, J., Clark, S., Liu, E., & Frazier, P. I. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1602.05149 · Cited by 61
Learning Compositional Koopman Operators for Model-Based ControlPreprint
Li, Y., He, H., Wu, J., Katabi, D., & Torralba, A. B. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1910.08264 · Cited by 61
Flaxman, S. R., Chirico, M., Pereira, P., & Loeffler, C. E. (2019) · The Annals of Applied Statistics · doi:10.1214/19-aoas1284 · Cited by 65
Mixed-Integer Convex Nonlinear Optimization with Gradient-Boosted Trees Embedded
Mistry, M., Letsios, D., Krennrich, G., Lee, R. M., & Misener, R. (2020) · INFORMS journal on computing · doi:10.1287/ijoc.2020.0993 · Cited by 68
Deterministic global optimization with Gaussian processes embedded
Schweidtmann, A. M., Bongartz, D., Grothe, D., Kerkenhoff, T., Lin, X., Najman, J., & Mitsos, A. (2021) · Mathematical Programming Computation · doi:10.1007/s12532-021-00204-y · Cited by 60
Hossain, S. M. Z., Sultana, N., Jassim, M. S., Coskuner, G., Hazin, L. M., Razzak, S. A., & Hossain, M. M. (2022) · Journal of Water Process Engineering · doi:10.1016/j.jwpe.2021.102490 · Cited by 61
Noh, W., Park, S., Kim, J., & Lee, I. (2022) · International Journal of Energy Research · doi:10.1002/er.8064 · Cited by 60
On-line transfer learning for multi-fidelity data fusion with ensemble of deep neural networks
Li, Z., Zhang, S., Li, H., Tian, K., Cheng, Z., Chen, Y., & Wang, B. (2022) · Advanced Engineering Informatics · doi:10.1016/j.aei.2022.101689 · Cited by 60
MITIE: Simultaneous RNA-Seq-based transcript identification and quantification in multiple samples
Behr, J., Kahles, A., 田中, 義., Sreedharan, V. T., Drewe, P., & Rätsch, G. (2013) · Bioinformatics · doi:10.1093/bioinformatics/btt442 · Cited by 58
Using meta-learning to initialize bayesian optimization of hyperparameters
Feurer, M., Springenberg, J. T., & Hutter, F. (2014) · Cited by 60
An ADMM Based Framework for AutoML Pipeline Configuration
Liu, S., Ram, P., Vijaykeerthy, D., Bouneffouf, D., Bramble, G., Samulowitz, H., Wang, D., Conn, A. R., & Gray, A. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i04.5926 · Cited by 60
BOFFIN TTS: Few-Shot Speaker Adaptation by Bayesian Optimization
Moss, H. B., Aggarwal, V., Prateek, N., González, J., & Barra-Chicote, R. (2020) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp40776.2020.9054301 · Cited by 60
Amirabadi, M. A., Kahaei, M. H., & Nezamalhosseini, S. A. (2020) · Physical Communication · doi:10.1016/j.phycom.2020.101057 · Cited by 60
Sevil, M., Rashid, M. M., Maloney, Z., Hajizadeh, I., Samadi, S., Askari, M. R., Hobbs, N., Brandt, R., Park, M., Quinn, L., et al. (2020) · IEEE Sensors Journal · doi:10.1109/jsen.2020.3000772 · Cited by 61
Restructuring Batch Normalization to Accelerate CNN TrainingPreprint
Jung, W., Jung, D.-J., Kim, A. B., Lee, S., Rhee, W., & Ahn, J. H. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1807.01702 · Cited by 71
Accuracy of machine learning for differentiation between optic neuropathies and pseudopapilledema
Ahn, J. M., Kim, S., Ahn, K., Cho, S., & Kim, U. S. (2019) · BMC Ophthalmology · doi:10.1186/s12886-019-1184-0 · Cited by 62
Resource Usage and Performance Trade-offs for Machine Learning Models in Smart Environments
Preuveneers, D., Tsingenopoulos, I., & Joosen, W. (2020) · Sensors · doi:10.3390/s20041176 · Cited by 60
Putra, T. A., Rufaida, S. I., & Leu, J. (2020) · IEEE Access · doi:10.1109/access.2020.2976045 · Cited by 60
Bayesian Optimization Objective-Based Experimental Design
Imani, M., & Ghoreishi, S. F. (2020) · Proceedings of the ... American Control Conference/Proceedings of the American Control Conference · doi:10.23919/acc45564.2020.9147824 · Cited by 59
Neural networks for parameter estimation in intractable models
Lenzi, A., Bessac, J., Rudi, J., & Stein, M. L. (2023) · Computational Statistics & Data Analysis · doi:10.1016/j.csda.2023.107762 · Cited by 59
El-Rashidy, N. M., Abuhmed, T., Alarabi, L., El-Bakry, H. M., Abdelrazek, S. M., Ali, F., & El–Sappagh, S. (2021) · Neural Computing and Applications · doi:10.1007/s00521-021-06631-1 · Cited by 58
Otaki, D., Nonaka, H., & Yamada, N. (2021) · International Journal of Heat and Mass Transfer · doi:10.1016/j.ijheatmasstransfer.2021.122263 · Cited by 59
LMPred: predicting antimicrobial peptides using pre-trained language models and deep learning
Dee, W. (2022) · Bioinformatics Advances · doi:10.1093/bioadv/vbac021 · Cited by 63
Systematic design of Cauchy symmetric structures through Bayesian optimization
Sheikh, H. M., Meier, T., Blankenship, B. W., Vangelatos, Z., Zhao, N., Marcus, P., & Grigoropoulos, C. P. (2022) · International Journal of Mechanical Sciences · doi:10.1016/j.ijmecsci.2022.107741 · Cited by 59
A review of algorithmic approaches for cell culture media optimization
Zhou, T., Reji, R., Kairon, R. S., & Chiam, K. (2023) · Frontiers in Bioengineering and Biotechnology · doi:10.3389/fbioe.2023.1195294 · Cited by 65
Lima, J. P. S., Evangelista, F., & Soares, C. G. (2023) · Reliability Engineering & System Safety · doi:10.1016/j.ress.2023.109492 · Cited by 59
Metaheuristics optimization-based ensemble of deep neural networks for Mpox disease detection
Asif, S., Zhao, M., Tang, F., Zhu, Y., & Zhao, B. (2023) · Neural Networks · doi:10.1016/j.neunet.2023.08.035 · Cited by 60
He, X., Huang, W., & Lv, C. (2024) · Transportation Research Part C Emerging Technologies · doi:10.1016/j.trc.2024.104632 · Cited by 63
Malakouti, S. M., Karimi, F., Abdollahi, H., Menhaj, M. B., Suratgar, A. A., & Moradi, M. H. (2024) · Case Studies in Chemical and Environmental Engineering · doi:10.1016/j.cscee.2024.100881 · Cited by 59
Bayesian Optimization with a Finite Budget: An Approximate Dynamic Programming Approach
Lam, R., Willcox, K. E., & Wolpert, D. H. (2016) · neural information processing systems · Cited by 59
Patsilinakos, A., Artini, M., Papa, R., Sabatino, M., Božović, M., Garzoli, S., Vrenna, G., Buzzi, R., Manfredini, S., Selan, L., et al. (2019) · Molecules · doi:10.3390/molecules24050890 · Cited by 65
Wang, Q., Li, Q., Wu, D., Yu, Y., Tin‐Loi, F., Ma, J., & Gao, W. (2019) · Applied Mathematical Modelling · doi:10.1016/j.apm.2019.10.007 · Cited by 59
Machine Learning Protocols in Early Cancer Detection Based on Liquid Biopsy: A Survey
Liu, L., Chen, X., Petinrin, O. O., Zhang, W., Rahaman, S., Tang, Z., & Wong, K. (2021) · Life · doi:10.3390/life11070638 · Cited by 62
Auto-Keras: Efficient Neural Architecture Search with Network MorphismPreprint
Jin, H., Song, Q., & Xia, H. (2018) · arXiv (Cornell University) · Cited by 59
Bayesian Optimisation over Multiple Continuous and Categorical InputsPreprint
Ru, B., Alvi, A., Nguyen, V., Osborne, M. A., & Roberts, S. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1906.08878 · Cited by 59
A flexible transfer learning framework for Bayesian optimization with convergence guarantee
Joy, T. T., Rana, S., Gupta, S., & Venkatesh, S. (2018) · Expert Systems with Applications · doi:10.1016/j.eswa.2018.08.023 · Cited by 62
Exploration Enhanced Expected Improvement for Bayesian Optimization
Berk, J., Nguyen, V., Gupta, S., Rana, S., & Venkatesh, S. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-10928-8_37 · Cited by 58
Liu, Z., Lyu, C., Huo, J., Wang, S., & Chen, J. (2022) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2022.3155527 · Cited by 58
Liu, C., Wang, R. R., Ho, I., Kong, Z., Williams, C. B., Babu, S. S., & Joslin, C. (2022) · Journal of Intelligent Manufacturing · doi:10.1007/s10845-022-01933-0 · Cited by 58
Tripathi, B., & Sharma, R. K. (2022) · Computational Economics · doi:10.1007/s10614-022-10325-8 · Cited by 59
Freire, P. J., Napoli, A., Spinnler, B., Anderson, M., Ron, D. A., Schairer, W., Bex, T., Costa, N. M. S., Turitsyn, S. K., & Prilepsky, J. E. (2023) · Journal of Lightwave Technology · doi:10.1109/jlt.2023.3234327 · Cited by 68
Multitype chatter detection via multichannelinternal and external signals in robotic milling
Deng, K., Yang, L., Lu, Y. J., & Ma, S. (2024) · Measurement · doi:10.1016/j.measurement.2024.114417 · Cited by 58
Kumar, R., Kumar, S., Rai, B., & Samui, P. (2024) · Structures · doi:10.1016/j.istruc.2024.106850 · Cited by 58
Discriminative shape from shading in uncalibrated illumination
Richter, S. R., & Roth, S. (2015) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2015.7298716 · Cited by 58
High Dimensional Bayesian Optimization via Restricted Projection Pursuit Models
Li, C., Kandasamy, K., Póczos, B., & Schneider, J. (2016) · International Conference on Artificial Intelligence and Statistics · Cited by 58
Juman++: A Morphological Analysis Toolkit for Scriptio Continua
Tolmachev, A., Kawahara, D., & Kurohashi, S. (2018) · Conference on Empirical Methods in Natural Language Processing: System Demonstrations (EMNLP) · doi:10.18653/v1/d18-2010 · Cited by 58
Abokersh, M. H., Vallès, M., Cabeza, L. F., & Boer, D. T. (2020) · Applied Energy · doi:10.1016/j.apenergy.2020.114903 · Cited by 58
Anysz, H., Brzozowski, Ł., Kretowicz, W., & Narloch, P. L. (2020) · Materials · doi:10.3390/ma13102317 · Cited by 64
Automated crystal structure analysis based on blackbox optimisation
Ozaki, Y., Suzuki, Y., Hawai, T., Saito, K., Onishi, M., & Ono, K. (2020) · npj Computational Materials · doi:10.1038/s41524-020-0330-9 · Cited by 58
Bayesian neural network–based thermal error modeling of feed drive system of CNC machine tool
Shi, H., Chunping, J., Yan, Z., Tao, T., & Mei, X. (2020) · The International Journal of Advanced Manufacturing Technology · doi:10.1007/s00170-020-05541-1 · Cited by 58
Bayesian optimization with output-weighted optimal sampling
Blanchard, A. B., & Sapsis, T. P. (2020) · Journal of Computational Physics · doi:10.1016/j.jcp.2020.109901 · Cited by 58
Fiorentini, N., Maboudi, M., Leandri, P., Losa, M., & Gerke, M. (2020) · Remote Sensing · doi:10.3390/rs12233976 · Cited by 58
Fuchs, A., Heider, Y., Wang, K., Sun, W., & Kaliske, M. (2021) · Computers & Structures · doi:10.1016/j.compstruc.2021.106505 · Cited by 57
Easy Hyperparameter Search Using OptunityPreprint
Claesen, M., Simm, J., Popovic, D. D., Moreau, Y., & Moor, B. D. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1412.1114 · Cited by 59
Batched Gaussian Process Bandit Optimization via Determinantal Point ProcessesPreprint
Kathuria, T., Deshpande, A., & Kohli, P. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.04088 · Cited by 58
GTApprox: Surrogate modeling for industrial design
Belyaev, M., Burnaev, E. V., Kapushev, E., Panov, M., Prikhodko, P., Vetrov, D., & Yarotsky, D. (2016) · Advances in Engineering Software · doi:10.1016/j.advengsoft.2016.09.001 · Cited by 57
A Modified Bayesian Optimization based Hyper-Parameter Tuning Approach for Extreme Gradient Boosting
Putatunda, S., & Rama, K. (2019) · doi:10.1109/icinpro47689.2019.9092025 · Cited by 57
AutoTune: Automatically Tuning Convolutional Neural Networks for Improved Transfer Learning
Basha, S. H. S., Vinakota, S. K., Pulabaigari, V., Mukherjee, S., & Dubey, S. R. (2020) · Neural Networks · doi:10.1016/j.neunet.2020.10.009 · Cited by 59
Multi-view gait recognition system using spatio-temporal features and deep learning
Gul, S., Malik, M. I., Khan, G. M., & Faisal Shafait, B. (2021) · Expert Systems with Applications · doi:10.1016/j.eswa.2021.115057 · Cited by 57
Asaly, S., Gottlieb, L.-A. J., Inbar, ., & Reuveni, Y. (2022) · Remote Sensing · doi:10.3390/rs14122822 · Cited by 60
Zhan, S., Wichern, G., Laughman, C. R., Chong, A., & Chakrabarty, A. (2022) · Energy and Buildings · doi:10.1016/j.enbuild.2022.112278 · Cited by 57
FiNER: Financial Numeric Entity Recognition for XBRL Tagging
Loukas, L., Fergadiotis, M., Chalkidis, I., Spyropoulou, E., Malakasiotis, P., Androutsopoulos, I., & Παλιούρας, Γ. (2022) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2022.acl-long.303 · Cited by 84
Diessner, M., O’Connor, J., Wynn, A., Laizet, S., Guan, Y., Wilson, K. J., & Whalley, R. D. (2022) · Frontiers in Applied Mathematics and Statistics · doi:10.3389/fams.2022.1076296 · Cited by 57
Jörges, C., Berkenbrink, C., Gottschalk, H., & Stumpe, B. (2023) · Ocean Engineering · doi:10.1016/j.oceaneng.2023.113699 · Cited by 57
Omnidirectional 3D reconstruction in augmented Manhattan worlds
Schonbein, M., & Geiger, A. (2014) · 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems · doi:10.1109/iros.2014.6942637 · Cited by 63
On the Importance of Hyperparameter Optimization for Model-based Reinforcement Learning
Zhang, B., Rajan, R., Pineda, L., Lambert, N., Biedenkapp, A., Chua, K., Hutter, F., & Calandra, R. (2021) · arXiv · doi:10.48550/arxiv.2102.13651 · Cited by 53
HyperPower: Power- and memory-constrained hyper-parameter optimization for neural networks
Stamoulis, D., Cai, E., Juan, D.-C., & Marculescu, D. (2018) · 2018 Design, Automation & Test in Europe Conference & Exhibition (DATE) · doi:10.23919/date.2018.8341973 · Cited by 67
Chae, S. G., Bae, S. J., & Oh, K.-Y. (2025) · Journal of Energy Storage · doi:10.1016/j.est.2024.114826 · Cited by 47
Chen, X., Wang, C., Li, Z., Hou, Z., & Yin, W.-J. (2020) · Science China Materials · doi:10.1007/s40843-019-1255-4 · Cited by 47
Anomaly detection for a water treatment system based on one-class neural network
Aboah Boateng, E., Bruce, J. W., & Talbert, D. A. (2022) · IEEE Access · doi:10.1109/access.2022.3218624 · Cited by 44
Metadata
- Authors
- Snoek, J., Larochelle, H., & Adams, R. P.
- Affiliations
- University of Toronto (CA)
- Université de Sherbrooke (CA)
- Harvard University (US)
- ORCID
- Adams, Ryan P.
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2012
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1206.2944
- OpenAlex
- W2131241448
- Cited by
- 6,691
- References
- 23
- Citations by year
- 2026: 62 · 2025: 630 · 2024: 779 · 2023: 712 · 2022: 720 · 2021: 997 · 2020: 864 · 2019: 680 · 2018: 465 · 2017: 289 · 2016: 212 · 2015: 144 · 2014: 94 · 2013: 34 · 2012: 9
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- Digital Access to Scholarship at Harvard (DASH) (Harvard University) (submittedVersion, cc-by)
- arXiv (Cornell University)
- Funders
- Defense Advanced Research Projects Agency
- Natural Sciences and Engineering Research Council of Canada
- Topics
- Social Sciences › Decision Sciences › Management Science and Operations Research › Advanced Bandit Algorithms Research
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning and Data Classification
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning and Algorithms
- Keywords
- Bayesian optimization, hyperparameter optimization, Gaussian process priors, latent Dirichlet allocation, structured support vector machines, convolutional neural networks
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
