The DOI matches its DataCite record; 23 of the 23 references it cites were found in a registry or an index.
Practical Bayesian Optimization of Machine Learning Algorithms
Open accessAbstract
Machine learning algorithms frequently require careful tuning of model hyperparameters, regularization terms, and optimization parameters. Unfortunately, this tuning is often a "black art" that requires expert experience, unwritten rules of thumb, or sometimes brute-force search. Much more appealing is the idea of developing automatic approaches which can optimize the performance of a given learning algorithm to the task at hand. In this work, we consider the automatic tuning problem within the framework of Bayesian optimization, in which a learning algorithm's generalization performance is modeled as a sample from a Gaussian process (GP). The tractable posterior distribution induced by the GP leads to efficient use of the information gathered by previous experiments, enabling optimal choices about what parameters to try next. Here we show how the effects of the Gaussian process prior and the associated inference procedure can have a large impact on the success or failure of Bayesian optimization. We show that thoughtful choices can lead to results that exceed expert-level performance in tuning machine learning algorithms. We also describe new algorithms that take into account the variable cost (duration) of learning experiments and that can leverage the presence of multiple cores for parallel experimentation. We show that these proposed algorithms improve on previous automatic procedures and can reach or surpass human expert-level optimization on a diverse set of contemporary algorithms including latent Dirichlet allocation, structured SVMs and convolutional neural networks.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“Validation accuracy can also guide hyperparameter and architecture search (Snoek et al., 2012;Zoph & Le, 2017); both uses reduce the validation set to a single number.”
From VERSE: Verified Self-Evolving Optimizer for Agent Harnesses (2026) · cites this paper as Snoek et al., 2012
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Learning Multiple Layers of Features from Tiny Images
Krizhevsky, A. (2024) · doi:10.57702/zp44cu3g · Cited by 23,889
Gaussian Processes for Machine Learning
Rasmussen, C. E., & Williams, C. K. I. (2005) · doi:10.7551/mitpress/3206.001.0001 · Cited by 11,705
(2012) · Cited by 8,009
Bayesian calibration of computer models
Kennedy, M. C., & O'Hagan, A. (2001) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/1467-9868.00294 · Cited by 4,222
(2011) · Cited by 3,939
Multi-column deep neural networks for image classification
Ciresan, D. C., Meier, U., & Schmidhuber, J. (2012) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2012.6248110 · Cited by 3,880
Brochu, E., Cora, V. M., & de Freitas, N. (2010) · arXiv (Cornell University) · doi:10.48550/arxiv.1012.2599 · Cited by 2,568
Sequential Model-Based Optimization for General Algorithm Configuration
Hutter, F., Hoos, H. H., & Leyton-Brown, K. (2011) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-25566-3_40 · Cited by 2,469
A Taxonomy of Global Optimization Methods Based on Response Surfaces
Jones, D. R. (2001) · Journal of Global Optimization · doi:10.1023/a:1012771025575 · Cited by 2,160
Information-Theoretic Regret Bounds for Gaussian Process Optimization in the Bandit Setting
Srinivas, N., Krause, A., Kakade, S. M., & Seeger, M. (2012) · IEEE Transactions on Information Theory · doi:10.48550/arxiv.0912.3995 · Cited by 2,100
Research works printed but not linked: 2
- Niranjan Srinivas, Andreas Krause, Sham Kakade, and Matthias Seeger. Gaussian process optimization in the bandit setting: No regret and experimental design. In ICML , 2010.
- Kevin Miller, M. Pawan Kumar, Benjamin Packer, Danny Goodman, and Daphne Koller. Max-margin minentropy models. In AISTATS , 2012.
Cited by
Sorted by citations
Items 601–700 of 1,026
Sarkar, M., & Bruyn, A. D. (2020) · Journal of Interactive Marketing · doi:10.1016/j.intmar.2020.07.002 · Cited by 107
GPS-ABC: Gaussian Process Surrogate Approximate Bayesian Computation
Meeds, E., & Welling, M. (2014) · UvA-DARE (University of Amsterdam) · doi:10.48550/arxiv.1401.2838 · Cited by 92
Learning hyperparameter optimization initializations
Wistuba, M., Schilling, N., & Schmidt-Thieme, L. (2015) · IEEE International Conference on Data Science and Advanced Analytics (DSAA) · doi:10.1109/dsaa.2015.7344817 · Cited by 107
Rahman, A., & Smith, A. D. (2018) · Applied Energy · doi:10.1016/j.apenergy.2018.06.064 · Cited by 92
Chen, G., Gan, M., & Chen, G. (2018) · Information Sciences · doi:10.1016/j.ins.2018.01.029 · Cited by 91
Nuovo, A. G. D., Conti, D., Trubia, G., Buono, S., & Nuovo, S. D. (2018) · Robotics · doi:10.3390/robotics7020025 · Cited by 91
Data-Driven Short-Term Solar Irradiance Forecasting Based on Information of Neighboring Sites
Huang, C., Wang, L., & Lai, L. L. (2018) · IEEE Transactions on Industrial Electronics · doi:10.1109/tie.2018.2856199 · Cited by 91
An ensemble prediction model for train delays
Nair, R., Hoang, T. L., Laumanns, M., Chen, B., Cogill, R., Szabó, J., & Walter, T. (2019) · Transportation Research Part C Emerging Technologies · doi:10.1016/j.trc.2019.04.026 · Cited by 91
Du, X., Xu, H., & Zhu, F. (2021) · Computer-Aided Design · doi:10.1016/j.cad.2021.103013 · Cited by 99
Almaatouq, A., Griffiths, T. L., Suchow, J. W., Whiting, M. E., Evans, J., & Watts, D. J. (2022) · Behavioral and Brain Sciences · doi:10.1017/s0140525x22002874 · Cited by 134
An accident diagnosis algorithm using long short-term memory
Yang, J., & Kim, J.-H. (2018) · Nuclear Engineering and Technology · doi:10.1016/j.net.2018.03.010 · Cited by 92
Thung, K.-H., Yap, P.-T., Adeli, E., Lee, S.-W., & Shen, D. (2018) · Medical Image Analysis · doi:10.1016/j.media.2018.01.002 · Cited by 89
Automated Design of Metaheuristic Algorithms
Stützle, T., & López‐Ibáñez, M. (2018) · International series in management science/operations research/International series in operations research & management science · doi:10.1007/978-3-319-91086-4_17 · Cited by 90
Mantovani, R. G., Rossi, A. L. D., Alcobaça, E., Vanschoren, J., & de Carvalho, A. C. P. L. F. (2019) · Information Sciences · doi:10.1016/j.ins.2019.06.005 · Cited by 90
Towards reliable named entity recognition in the biomedical domain
Giorgi, J., & Bader, G. D. (2019) · Bioinformatics · doi:10.1093/bioinformatics/btz504 · Cited by 91
Deep clustering of protein folding simulations
Bhowmik, D., Gao, S. B., Young, M. T., & Ramanathan, A. (2018) · BMC Bioinformatics · doi:10.1186/s12859-018-2507-5 · Cited by 87
Arrow: Low-Level Augmented Bayesian Optimization for Finding the Best Cloud VM
Hsu, C.-J., Nair, V., Freeh, V. W., & Menzies, T. (2018) · IEEE International Conference on Distributed Computing Systems (ICDCS) · doi:10.1109/icdcs.2018.00070 · Cited by 90
Jiang, D., Lei, T., Wang, Z., Shen, C., Cao, D., & Hou, T. (2020) · Journal of Cheminformatics · doi:10.1186/s13321-020-00421-y · Cited by 94
Detect, Consolidate, Delineate: Scalable Mapping of Field Boundaries Using Satellite Images
Waldner, F., Diakogiannis, F. I., Batchelor, K. L., Ciccotosto-Camp, M., Cooper, E. J., Herrmann, C., Mata, G., & Toovey, A. F. (2021) · Remote Sensing · doi:10.3390/rs13112197 · Cited by 93
Reza, M. S., Mannan, M., Mansor, M., Ker, P. J., Mahlia, T. M. I., & Hannan, M. A. (2024) · Energy Reports · doi:10.1016/j.egyr.2024.04.039 · Cited by 95
Big Learning with Bayesian methods
Zhu, J., Chen, J., Hu, W., & Zhang, B. (2017) · National Science Review · doi:10.1093/nsr/nwx044 · Cited by 100
Bayesian optimization of a hybrid system for robust ocean wave features prediction
Cornejo-Bueno, L. M., Garrido‐Merchán, E. C., Hernández-Lobato, D., & Salcedo‐Sanz, S. (2017) · Neurocomputing · doi:10.1016/j.neucom.2017.09.025 · Cited by 93
Automatic Croup Diagnosis Using Cough Sound Recognition
Sharan, R. V., Abeyratne, U. R., Swarnkar, V. R., & Porter, P. (2018) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2018.2849502 · Cited by 89
Online Hyper-Parameter Learning for Auto-Augmentation Strategy
Lin, C., Guo, M., Li, C., Yuan, X., Wu, W., Yan, J., Lin, D., & Ouyang, W. (2019) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00668 · Cited by 96
Adaptation Strategies for Automated Machine Learning on Evolving Data
Çelik, B., & Vanschoren, J. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2021.3062900 · Cited by 89
Demystifying Machine Learning for Signal and Power Integrity Problems in Packaging
Swaminathan, M., Torun, H. M., Yu, H., Hejase, J. A., & Becker, D. (2020) · IEEE Transactions on Components Packaging and Manufacturing Technology · doi:10.1109/tcpmt.2020.3011910 · Cited by 89
Ramchandani, A., Fan, C. H., & Mostafavi, A. (2020) · IEEE Access · doi:10.1109/access.2020.3019989 · Cited by 91
Sultana, N. N., Hossain, S. M. Z., Alam, M. S., Islam, M. S., & Abtah, M. A. A. (2020) · Advances in Engineering Software · doi:10.1016/j.advengsoft.2020.102887 · Cited by 89
HOLMES: Health OnLine Model Ensemble Serving for Deep Learning Models in Intensive Care Units
Hong, S., Xu, Y., Khare, A., Priambada, S., Maher, K., Aljiffry, A., Sun, J., & Tumanov, A. (2020) · Proceedings of the 26th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining · doi:10.1145/3394486.3403212 · Cited by 89
Jacobs, J. P. (2021) · IEEE Antennas and Wireless Propagation Letters · doi:10.1109/lawp.2021.3113389 · Cited by 89
Mushava, J., & Murray, M. P. (2022) · Expert Systems with Applications · doi:10.1016/j.eswa.2022.117233 · Cited by 90
Du, S., Wang, J., Wang, M., Yang, J., Zhang, C., Zhao, Y. S., & Song, H. (2022) · Energy · doi:10.1016/j.energy.2022.126121 · Cited by 92
Parallel and Distributed Thompson Sampling for Large-scale Accelerated Exploration of Chemical SpacePreprint
Hernández-Lobato, J. M., Requeima, J., Pyzer‐Knapp, E. O., & Aspuru‐Guzik, A. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1706.01825 · Cited by 94
Triguero, I., Molina, D., Poyatos, J., Del Ser, J., & Herrera, F. (2024) · Information Fusion · doi:10.1016/j.inffus.2023.102135 · Cited by 90
Learning and Control Using Gaussian Processes
Jain, A., Nghiem, T. X., Morari, M., & Mangharam, R. (2018) · International Conference on Cyber-Physical Systems · doi:10.1109/iccps.2018.00022 · Cited by 94
Fernández-Tobías, I., Iván Cantador, A., Tomeo, P., Anelli, V. W., & Noia, T. D. (2019) · User Modeling and User-Adapted Interaction · doi:10.1007/s11257-018-9217-6 · Cited by 88
da Cunha, W. L. M., Mangaravite, V., Gomes, C., Canuto, S., Resende, E., Nascimento, C., Viegas, F. A. R., França, C., Martins, W. S., Almeida, J. M., et al. (2021) · Information Processing & Management · doi:10.1016/j.ipm.2020.102481 · Cited by 92
Raji, I. D., Bello-Salau, H., Umoh, I. J., Onumanyi, A. J., Adegboye, M. A., & Salawudeen, A. T. (2022) · Applied Sciences · doi:10.3390/app12031186 · Cited by 96
Ensemble Multifeatured Deep Learning Models and Applications: A Survey
Abimannan, S., El-Alfy, E.-S. M., Chang, Y., Hussain, S., Shukla, S., & Satheesh, D. (2023) · IEEE Access · doi:10.1109/access.2023.3320042 · Cited by 107
Generalized Inner Loop Meta-LearningPreprint
Grefenstette, E., Amos, B., Yarats, D., Htut, P. M., Molchanov, A., Meier, F., Kiela, D., Cho, K., & Chintala, S. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1910.01727 · Cited by 88
LEARN Codes: Inventing Low-Latency Codes via Recurrent Neural Networks
Jiang, Y., Kim, H., Asnani, H., Kannan, S., Oh, S., & Viswanath, P. (2019) · International Conference on Communications · doi:10.1109/icc.2019.8761286 · Cited by 86
Yu, G., Chen, P., & Zheng, Z. (2020) · IEEE Transactions on Cloud Computing · doi:10.1109/tcc.2020.2985352 · Cited by 87
Sequential gallery for interactive visual design optimization
Koyama, Y., Sato, I., & Goto, M. (2020) · ACM Transactions on Graphics · doi:10.1145/3386569.3392444 · Cited by 87
Automated Machine Learning—A Brief Review at the End of the Early Years
Escalante, H. J. (2021) · Natural computing series · doi:10.1007/978-3-030-72069-8_2 · Cited by 86
Ham, Y., Kim, J.-H., Kim, E.-S., & On, K.-W. (2021) · 中国科学通报：英文版 · doi:10.1016/j.scib.2021.03.009 · Cited by 87
Soper, D. S. (2021) · Electronics · doi:10.3390/electronics10161973 · Cited by 100
Dynamic Selection Techniques for Detecting GPS Spoofing Attacks on UAVs
Khoei, T. T., Ismail, S. S., & Kaabouch, N. (2022) · Sensors · doi:10.3390/s22020662 · Cited by 87
Efficient Hyperparameter Optimization in Deep Learning Using a Variable Length Genetic AlgorithmPreprint
Xiao, X., Yan, M., Basodi, S., Ji, C., & Pan, Y. F. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.12703 · Cited by 87
LEARN Codes: Inventing Low-Latency Codes via Recurrent Neural Networks
Jiang, Y., Kim, H., Asnani, H., Kannan, S., Oh, S., & Viswanath, P. (2020) · IEEE Journal on Selected Areas in Information Theory · doi:10.1109/jsait.2020.2988577 · Cited by 87
Yao, Y., Xiao, Z., Wang, B., Viswanath, B., Zheng, H.-T., & Zhao, B. Y. (2017) · ACM Internet Measurement Conference (IMC) · doi:10.1145/3131365.3131372 · Cited by 89
Convolutional Neural Network With Adaptive Regularization to Classify Driving Styles on Smartphones
Bejani, M. M., & Ghatee, M. (2019) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2019.2896672 · Cited by 89
Exploring the impact of foot-by-foot track geometry on the occurrence of rail defects
Mohammadi, R., He, Q., Ghofrani, F., Pathak, A., & Aref, A. J. (2019) · Transportation Research Part C Emerging Technologies · doi:10.1016/j.trc.2019.03.004 · Cited by 86
Evolution of Deep Convolutional Neural Networks Using Cartesian Genetic Programming
Suganuma, M., Kobayashi, M., Shirakawa, S., & Nagao, T. (2019) · Evolutionary Computation · doi:10.1162/evco_a_00253 · Cited by 89
Richter, C., Rößler, T., Kunze, G., Katterfeld, A., & Will, F. (2019) · Powder Technology · doi:10.1016/j.powtec.2019.10.052 · Cited by 92
Bayesian‐optimized unsupervised learning approach for structural damage detection
Eltouny, K., & Liang, X. P. (2021) · Computer-Aided Civil and Infrastructure Engineering · doi:10.1111/mice.12680 · Cited by 86
Lorenz, R., Monti, R. P., Violante, I. R., Anagnostopoulos, C., Faisal, A. A., Montana, G., & Leech, R. (2016) · NeuroImage · doi:10.1016/j.neuroimage.2016.01.032 · Cited by 85
Explainability of Machine Learning Models for Bankruptcy Prediction
Park, M. S., Son, H., Hyun, C., & Hwang, H. J. (2021) · IEEE Access · doi:10.1109/access.2021.3110270 · Cited by 83
Hyper-parameter selection in deep neural networks using parallel particle swarm optimization
Lorenzo, P. R., Nalepa, J., Ramos, L. S., & Ranilla, J. (2017) · Genetic and Evolutionary Computation Conference Companion (GECCO Companion) · doi:10.1145/3067695.3084211 · Cited by 87
Sequential line search for efficient visual design optimization by crowds
Koyama, Y., Sato, I., Sakamoto, D., & Igarashi, T. (2017) · ACM Transactions on Graphics · doi:10.1145/3072959.3073598 · Cited by 85
Zeng, X., & Luo, G. (2017) · Health Information Science and Systems · doi:10.1007/s13755-017-0023-z · Cited by 92
Aspect-Based Financial Sentiment Analysis using Deep Learning
Jangid, H., Singhal, S., Shah, R. R., & Zimmermann, R. (2018) · International World Wide Web Conference (WWW) · doi:10.1145/3184558.3191827 · Cited by 85
Vecchia Approximations of Gaussian-Process Predictions
Katzfuss, M., Guinness, J., Gong, W., & Zilber, D. (2020) · Journal of Agricultural Biological and Environmental Statistics · doi:10.1007/s13253-020-00401-7 · Cited by 85
Predicting Multiple Properties of Pervious Concrete through the Gaussian Process Regression
Zhang, Y., & Xu, X. (2021) · Advances in Civil Engineering Materials · doi:10.1520/acem20200134 · Cited by 85
HEBO: An Empirical Study of Assumptions in Bayesian Optimisation
Cowen-Rivers, A. I., Lyu, W., Tutunov, R., Wang, Z., Grosnit, A., Griffiths, R., Maraval, A., Hao, J., Wang, J., Peters, J., et al. (2022) · Journal of Artificial Intelligence Research · doi:10.1613/jair.1.13643 · Cited by 117
Chen, H., Yang, J., Fu, X., Zheng, Q., Song, X., Fu, Z., Wang, J., Liang, Y., Yin, H., Liu, Z., et al. (2022) · Sustainability · doi:10.3390/su142013231 · Cited by 95
Moradi, M., Broer, A. A. R., Chiachío, J., Benedictus, R., Λούτας, Θ., & Zarouchas, D. S. (2022) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2022.105502 · Cited by 94
Hoffman, M. D., Shahriari, B., & de Freitas, N. (2014) · International Conference on Artificial Intelligence and Statistics · Cited by 85
Improving Deep Neural Networks with Probabilistic Maxout UnitsPreprint
Springenberg, J. T., & Riedmiller, M. (2013) · arXiv (Cornell University) · doi:10.48550/arxiv.1312.6116 · Cited by 94
Pollux: Co-adaptive Cluster Scheduling for Goodput-Optimized Deep LearningPreprint
Qiao, A., Choe, S. K., Subramanya, S. J., Neiswanger, W., Ho, Q., Zhang, H., Ganger, G. R., & Xing, E. P. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2008.12260 · Cited by 90
A convolutional neural network to filter artifacts in spectroscopic MRI
Gurbani, S. S., Schreibmann, E., Maudsley, A. A., Cordova, J. S., Soher, B. J., Poptani, H., Verma, G., Barker, P. B., Shim, H., & Cooper, L. A. D. (2018) · Magnetic Resonance in Medicine · doi:10.1002/mrm.27166 · Cited by 84
A Haze Prediction Model in Chengdu Based on LSTM
Wu, X., Liu, Z., Yin, L., Zheng, W., Song, L., Tian, J., Yang, B., & Liu, S. (2021) · Atmosphere · doi:10.3390/atmos12111479 · Cited by 84
Coordinated Batching and DVFS for DNN Inference on GPU Accelerators
Nabavinejad, S. M., Reda, S., & Ebrahimi, M. (2022) · IEEE Transactions on Parallel and Distributed Systems · doi:10.1109/tpds.2022.3144614 · Cited by 84
Learning values across many orders of magnitudePreprint
van Hasselt, H. P., Guez, A., Hessel, M., Mnih, V., & Silver, D. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1602.07714 · Cited by 102
A machine learning approach for efficient uncertainty quantification using multiscale methods
Chan, S., & Elsheikh, A. H. (2017) · Journal of Computational Physics · doi:10.1016/j.jcp.2017.10.034 · Cited by 83
Efficient Closed-loop Maximization of Carbon Nanotube Growth Rate using Bayesian Optimization
Chang, J., Nikolaev, P. N., Carpena‐Núñez, J., Rao, R. S., Decker, K., Islam, A. E., Kim, J., Pitt, M. A., Myung, J. I., & Maruyama, B. (2020) · Scientific Reports · doi:10.1038/s41598-020-64397-3 · Cited by 88
COVIDiag: a clinical CAD system to diagnose COVID-19 pneumonia based on CT findings
Ardakani, A. A., Acharya, U. R., Habibollahi, S., & Mohammadi, A. (2020) · European Radiology · doi:10.1007/s00330-020-07087-y · Cited by 83
Time efficiency in optimization with a bayesian-Evolutionary algorithm
Lan, G., Tomczak, J. M., Roijers, D. M., & Eiben, A. E. (2021) · Swarm and Evolutionary Computation · doi:10.1016/j.swevo.2021.100970 · Cited by 83
Sanfelici, R., Dwyer, D. B., Antonucci, L. A., & Koutsouleris, N. (2020) · Biological Psychiatry · doi:10.1016/j.biopsych.2020.02.009 · Cited by 82
Automatic Classification of Adventitious Respiratory Sounds: A (Un)Solved Problem?
Rocha, B., Pessoa, D., Marques, A. S. P. D. D., Carvalho, P., & Paiva, R. P. (2020) · Sensors · doi:10.3390/s21010057 · Cited by 82
NEXTorch: A Design and Bayesian Optimization Toolkit for Chemical Sciences and Engineering
Wang, Y., Chen, T.-Y., & Vlachos, D. G. (2021) · Journal of Chemical Information and Modeling · doi:10.1021/acs.jcim.1c00637 · Cited by 87
An introduction to machine learning and analysis of its use in rheumatic diseases
Kingsmore, K. M., Puglisi, C., Grammer, A. C., & Lipsky, P. E. (2021) · Nature Reviews Rheumatology · doi:10.1038/s41584-021-00708-w · Cited by 86
Qin, Q., Huang, Z., Zhou, Z., Chen, Y., & Zhao, W. (2022) · Applied Soft Computing · doi:10.1016/j.asoc.2022.108560 · Cited by 82
Anh, D. T., Pandey, M. K., Mishra, V. N., Singh, K. K., Ahmadi, K., Janizadeh, S., Tran, T. T., Linh, N. T. T., & Dang, N. M. (2022) · Applied Soft Computing · doi:10.1016/j.asoc.2022.109848 · Cited by 83
Oster, S., Breese, P. P., Ulbricht, A., Mohr, G., & Altenburg, S. J. (2023) · Journal of Intelligent Manufacturing · doi:10.1007/s10845-023-02117-0 · Cited by 82
Estimation of Citrus Maturity with Fluorescence Spectroscopy Using Deep Learning
Itakura, K., Saito, Y., Suzuki, T., Kondo, N., & Hosoi, F. (2018) · Horticulturae · doi:10.3390/horticulturae5010002 · Cited by 82
Bayesian Optimization of Combinatorial StructuresPreprint
Baptista, R., & Poloczek, M. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1806.08838 · Cited by 82
Clune, J. (2019) · arXiv · doi:10.48550/arxiv.1905.10985 · Cited by 82
Idakwo, G., Thangapandian, S., Luttrell, J., Zhou, Z., Zhang, C., & Gong, P. (2021) · US Army Corps of Engineers: Engineer Research and Development Center (Knowledge Core) · doi:10.21079/11681/41302 · Cited by 82
Evaluation of Machine Learning Classifiers for Predicting Deep Convection
Ukkonen, P., & Mäkelä, A. (2019) · Journal of Advances in Modeling Earth Systems · doi:10.1029/2018ms001561 · Cited by 81
Automated data-driven modeling of building energy systems via machine learning algorithms
Rätz, M., Javadi, A. P., Baranski, M., Finkbeiner, K., & Müller, D. (2019) · Energy and Buildings · doi:10.1016/j.enbuild.2019.109384 · Cited by 81
An Automated Hyperparameter Search-Based Deep Learning Model for Highway Traffic Prediction
Yi, H., & Bui, K. N. (2020) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2020.2987614 · Cited by 83
Chen, K., Laghrouche, S., & Djerdir, A. (2021) · IEEE Transactions on Energy Conversion · doi:10.1109/tec.2021.3121650 · Cited by 81
Hyperparameter Tuning for Machine and Deep Learning with R
Bartz, E., Bartz–Beielstein, T., Zaefferer, M., & Mersmann, O. (2022) · Springer eBooks · doi:10.1007/978-981-19-5170-1 · Cited by 115
Chen, P., Xia, J., Merrick, B. M., & Brazil, T. J. (2016) · IEEE Transactions on Microwave Theory and Techniques · doi:10.1109/tmtt.2016.2636146 · Cited by 81
Understanding Deep Architectures using a Recursive Convolutional NetworkPreprint
Eigen, D., Rolfe, J. T., Fergus, R., & LeCun, Y. (2013) · arXiv (Cornell University) · doi:10.48550/arxiv.1312.1847 · Cited by 130
Prognostication and risk factors for cystic fibrosis via automated machine learning
Alaa, A. M., & van der Schaar, M. (2018) · Scientific Reports · doi:10.1038/s41598-018-29523-2 · Cited by 80
HEp-2 Cell Classification Using Shape Index Histograms With Donut-Shaped Spatial Pooling
Larsen, A., Vestergaard, J. S., & Larsen, R. (2014) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2014.2318434 · Cited by 80
Sun, W., Jiang, M., Dang, J., Chang, P., & Yin, F.-F. (2018) · Radiation Oncology · doi:10.1186/s13014-018-1140-9 · Cited by 80
A Supervised Approach to Robust Photoplethysmography Quality Assessment
Pereira, T., Gadhoumi, K., Ma, M., Liu, X., Xiao, R., Colorado, R. A., Keenan, K. J., Meisel, K. M., & Hu, X. (2019) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2019.2909065 · Cited by 80
Safe Contextual Bayesian Optimization for Sustainable Room Temperature PID Control Tuning
Fiducioso, M., Curi, S., Schumacher, B., Gwerder, M., & Krause, A. (2019) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2019/811 · Cited by 80
Metadata
- Authors
- Snoek, J., Larochelle, H., & Adams, R. P.
- Affiliations
- University of Toronto (CA)
- Université de Sherbrooke (CA)
- Harvard University (US)
- ORCID
- Adams, Ryan P.
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2012
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1206.2944
- OpenAlex
- W2131241448
- Cited by
- 6,691
- References
- 23
- Citations by year
- 2026: 62 · 2025: 630 · 2024: 779 · 2023: 712 · 2022: 720 · 2021: 997 · 2020: 864 · 2019: 680 · 2018: 465 · 2017: 289 · 2016: 212 · 2015: 144 · 2014: 94 · 2013: 34 · 2012: 9
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- Digital Access to Scholarship at Harvard (DASH) (Harvard University) (submittedVersion, cc-by)
- arXiv (Cornell University)
- Funders
- Defense Advanced Research Projects Agency
- Natural Sciences and Engineering Research Council of Canada
- Topics
- Social Sciences › Decision Sciences › Management Science and Operations Research › Advanced Bandit Algorithms Research
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning and Data Classification
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning and Algorithms
- Keywords
- Bayesian optimization, hyperparameter optimization, Gaussian process priors, latent Dirichlet allocation, structured support vector machines, convolutional neural networks
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
