The DOI matches its DataCite record; 23 of the 23 references it cites were found in a registry or an index.
Practical Bayesian Optimization of Machine Learning Algorithms
Open accessAbstract
Machine learning algorithms frequently require careful tuning of model hyperparameters, regularization terms, and optimization parameters. Unfortunately, this tuning is often a "black art" that requires expert experience, unwritten rules of thumb, or sometimes brute-force search. Much more appealing is the idea of developing automatic approaches which can optimize the performance of a given learning algorithm to the task at hand. In this work, we consider the automatic tuning problem within the framework of Bayesian optimization, in which a learning algorithm's generalization performance is modeled as a sample from a Gaussian process (GP). The tractable posterior distribution induced by the GP leads to efficient use of the information gathered by previous experiments, enabling optimal choices about what parameters to try next. Here we show how the effects of the Gaussian process prior and the associated inference procedure can have a large impact on the success or failure of Bayesian optimization. We show that thoughtful choices can lead to results that exceed expert-level performance in tuning machine learning algorithms. We also describe new algorithms that take into account the variable cost (duration) of learning experiments and that can leverage the presence of multiple cores for parallel experimentation. We show that these proposed algorithms improve on previous automatic procedures and can reach or surpass human expert-level optimization on a diverse set of contemporary algorithms including latent Dirichlet allocation, structured SVMs and convolutional neural networks.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“Validation accuracy can also guide hyperparameter and architecture search (Snoek et al., 2012;Zoph & Le, 2017); both uses reduce the validation set to a single number.”
From VERSE: Verified Self-Evolving Optimizer for Agent Harnesses (2026) · cites this paper as Snoek et al., 2012
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Learning Multiple Layers of Features from Tiny Images
Krizhevsky, A. (2024) · doi:10.57702/zp44cu3g · Cited by 23,889
Gaussian Processes for Machine Learning
Rasmussen, C. E., & Williams, C. K. I. (2005) · doi:10.7551/mitpress/3206.001.0001 · Cited by 11,705
(2012) · Cited by 8,009
Bayesian calibration of computer models
Kennedy, M. C., & O'Hagan, A. (2001) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/1467-9868.00294 · Cited by 4,222
(2011) · Cited by 3,939
Multi-column deep neural networks for image classification
Ciresan, D. C., Meier, U., & Schmidhuber, J. (2012) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2012.6248110 · Cited by 3,880
Brochu, E., Cora, V. M., & de Freitas, N. (2010) · arXiv (Cornell University) · doi:10.48550/arxiv.1012.2599 · Cited by 2,568
Sequential Model-Based Optimization for General Algorithm Configuration
Hutter, F., Hoos, H. H., & Leyton-Brown, K. (2011) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-25566-3_40 · Cited by 2,469
A Taxonomy of Global Optimization Methods Based on Response Surfaces
Jones, D. R. (2001) · Journal of Global Optimization · doi:10.1023/a:1012771025575 · Cited by 2,160
Information-Theoretic Regret Bounds for Gaussian Process Optimization in the Bandit Setting
Srinivas, N., Krause, A., Kakade, S. M., & Seeger, M. (2012) · IEEE Transactions on Information Theory · doi:10.48550/arxiv.0912.3995 · Cited by 2,100
Research works printed but not linked: 2
- Niranjan Srinivas, Andreas Krause, Sham Kakade, and Matthias Seeger. Gaussian process optimization in the bandit setting: No regret and experimental design. In ICML , 2010.
- Kevin Miller, M. Pawan Kumar, Benjamin Packer, Danny Goodman, and Daphne Koller. Max-margin minentropy models. In AISTATS , 2012.
Cited by
Sorted by citations
Items 701–800 of 1,026
Automated spectroscopic modelling with optimised convolutional neural networks
Shen, Z., & Rossel, R. A. V. (2021) · Scientific Reports · doi:10.1038/s41598-020-80486-9 · Cited by 84
Kolar, D., Lisjak, D., Pająk, M., & Gudlin, M. (2021) · Sensors · doi:10.3390/s21072411 · Cited by 86
Westhues, C. C., Mahone, G. S., Silva, S. D., Thorwarth, P., Schmidt, M., Richter, J.-C., Simianer, H., & Beissinger, T. M. (2021) · Frontiers in Plant Science · doi:10.3389/fpls.2021.699589 · Cited by 81
Zhang, J., He, Y., Zhang, Y., Li, W., & Zhang, J. (2022) · Energies · doi:10.3390/en15103675 · Cited by 80
Machine learning based downscaling of GRACE-estimated groundwater in Central Valley, California
Agarwal, V., Akyılmaz, O., Shum, C. K., Feng, W., Yang, T., Forootan, E., Syed, T. H., Haritashya, U. K., & Uz, M. (2022) · The Science of The Total Environment · doi:10.1016/j.scitotenv.2022.161138 · Cited by 80
Application of Machine Learning Methodologies for Predicting Corn Economic Optimal Nitrogen Rate
Qin, Z., Myers, D. B., Ransom, C. J., Kitchen, N. R., Liang, S., Camberato, J. J., Carter, P. R., Ferguson, R. B., Fernández, F. G., Franzen, D. W., et al. (2018) · Agronomy Journal · doi:10.2134/agronj2018.03.0222 · Cited by 80
Bayesian Optimization with Exponential ConvergencePreprint
Kawaguchi, K., Kaelbling, L. P., & Lozano‐Pérez, T. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1604.01348 · Cited by 80
Bayesian Optimization in AlphaGoPreprint
Chen, Y., Huang, A., Wang, Z., Antonoglou, I., Schrittwieser, J., Silver, D., & de Freitas, N. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1812.06855 · Cited by 80
Flow-based Intrusion Detection System for SDN
Ajaeiya, G., Adalian, N., Elhajj, I. H., Kayssi, A., & Chehab, A. (2017) · IEEE Symposium on Computers and Communications (ISCC) · doi:10.1109/iscc.2017.8024623 · Cited by 85
AutoDispNet: Improving Disparity Estimation With AutoML
Saikia, T., Marrakchi, Y., Zela, A., Hutter, F., & Brox, T. (2019) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00190 · Cited by 78
Wang, W., Gao, J., Zhang, M., Wang, S., Chen, G., Ng, T. K., Ooi, B. C., Shao, J., & Reyad, M. (2018) · Proceedings of the VLDB Endowment · doi:10.14778/3282495.3282499 · Cited by 102
Zhang, G., Dai, Z., & Dai, X. (2020) · Computational and Structural Biotechnology Journal · doi:10.1016/j.csbj.2020.01.013 · Cited by 80
Searching to Exploit Memorization Effect in Learning with Noisy Labels
Yao, Q., Yang, H., Han, B., Niu, G., & Kwok, J. T.-Y. (2020) · Rare & Special e-Zone (The Hong Kong University of Science and Technology) · Cited by 79
Jeong, K., Lee, H., Kwon, O. M., Jung, J., Kwon, D., & Han, H. N. (2020) · Materials & Design · doi:10.1016/j.matdes.2020.109104 · Cited by 79
Robust Optimization and Validation of Echo State Networks for learning chaotic dynamics
Racca, A., & Magri, L. (2021) · Neural Networks · doi:10.1016/j.neunet.2021.05.004 · Cited by 78
Ko, J. U., Na, K., Oh, J.-S., Kim, J.-D., & Youn, B. D. (2021) · Expert Systems with Applications · doi:10.1016/j.eswa.2021.116094 · Cited by 86
Automatic detection of pneumonia in chest X-ray images using textural features
Ortiz-Toro, C. A., Garcia-Pedrero, A. M., Lillo‐Saavedra, M., & Gonzalo‐Martín, C. (2022) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2022.105466 · Cited by 92
Do We Need Zero Training Loss After Achieving Zero Training Error?Preprint
Ishida, T., Yamane, I., Sakai, T., Niu, G., & Sugiyama, M. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2002.08709 · Cited by 100
Modern Machine Learning as a Benchmark for Fitting Neural Responses
Benjamin, A. S., Fernandes, H. L., Tomlinson, T., Ramkumar, P., Versteeg, C., Chowdhury, R. H., Miller, L. E., & Kording, K. P. (2018) · Frontiers in Computational Neuroscience · doi:10.3389/fncom.2018.00056 · Cited by 82
Practical Design Space Exploration
Nardi, L., Koeplinger, D., & Olukotun, K. (2019) · Proceedings - International Symposium on Modeling, Analysis, and Simulation of Computer and Telecommunication Systems · doi:10.1109/mascots.2019.00045 · Cited by 78
Application of Bayesian Optimization for Pharmaceutical Product Development
Sano, S., Kadowaki, T., Tsuda, K., & Kimura, S. (2019) · Journal of Pharmaceutical Innovation · doi:10.1007/s12247-019-09382-8 · Cited by 78
TensorDash: Exploiting Sparsity to Accelerate Deep Neural Network Training
Mahmoud, M., Edo, I., Zadeh, A. H., Awad, O. M., Pekhimenko, G. G., Albericio, J., & Moshovos, A. (2020) · IEEE/ACM International Symposium on Microarchitecture (MICRO) · doi:10.1109/micro50266.2020.00069 · Cited by 78
Vaquerizo-Villar, F., Álvarez, D., Gozal, D., Gutiérrez‐Tobal, G. C., Barroso-García, V., Santamaría-Vázquez, E., del Campo, F., Gozal, D., & Hornero, R. (2021) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2020.3048901 · Cited by 78
The value of meteorological data in marine risk assessment
Ådland, R., Jia, H., Lode, T., & Skontorp, J. (2021) · Reliability Engineering & System Safety · doi:10.1016/j.ress.2021.107480 · Cited by 78
Deep Decision Network for Multi-class Image Classification
Murthy, V. N., Singh, V. K., Chen, T., Manmatha, R., & Comaniciu, D. (2016) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2016.246 · Cited by 78
Balasubramanian, K., & Ghadimi, S. (2021) · Foundations of Computational Mathematics · doi:10.1007/s10208-021-09499-8 · Cited by 85
Stochastic Hyperparameter Optimization through HypernetworksPreprint
Lorraine, J., & Duvenaud, D. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1802.09419 · Cited by 136
Bridging the Gap between Sample-based and One-shot Neural Architecture Search with BONASPreprint
Han, S., Pi, R., Xu, H., Li, Z., Kwok, J. T.-Y., & Zhang, T. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1911.09336 · Cited by 91
Max-value Entropy Search for Multi-Objective Bayesian Optimization
Belakaria, S., Deshwal, A., & Doppa, J. R. (2019) · neural information processing systems · Cited by 79
Gu, X., Han, Y., & Yu, J. (2020) · IEEE Access · doi:10.1109/access.2020.2964294 · Cited by 77
Machine Learning Approaches for Ship Speed Prediction towards Energy Efficient Shipping
Abebe, M., Shin, Y., Noh, Y., Lee, S.-B., & Lee, I. (2020) · Applied Sciences · doi:10.3390/app10072325 · Cited by 77
Multi-objective constrained Bayesian optimization for structural design
Mathern, A., Steinholtz, O. S., Sjöberg, A., Önnheim, M., Ek, K. H., Rempling, R., Gustavsson, E., & Jirstrand, M. (2020) · Structural and Multidisciplinary Optimization · doi:10.1007/s00158-020-02720-2 · Cited by 77
Data-Efficient Domain Randomization With Bayesian Optimization
Muratore, F., Eilers, C., Gienger, M., & Peters, J. (2021) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2021.3052391 · Cited by 77
Segmentation of photovoltaic module cells in uncalibrated electroluminescence images
Deitsch, S., Buerhop‐Lutz, C., Sovetkin, E., Steland, A., Maier, A., Gallwitz, F., & Rieß, C. (2021) · RWTH Publications (RWTH Aachen) · Cited by 77
A novel ensemble-based conceptual-data-driven approach for improved streamflow simulations
Sikorska‐Senoner, A. E., & Quilty, J. (2021) · Environmental Modelling & Software · doi:10.1016/j.envsoft.2021.105094 · Cited by 77
A stacked machine learning model for multi-step ahead prediction of lake surface water temperature
Nunno, F. D., Zhu, S., Ptak, M., Sojka, M., & Granata, F. (2023) · The Science of The Total Environment · doi:10.1016/j.scitotenv.2023.164323 · Cited by 77
Lu, D., & Ricciuto, D. M. (2019) · Geoscientific model development · doi:10.5194/gmd-12-1791-2019 · Cited by 77
Learning to Optimize Neural NetsPreprint
Li, K., & Malik, J. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1703.00441 · Cited by 137
Practical Multi-fidelity Bayesian Optimization for Hyperparameter TuningPreprint
Wu, J., Toscano-Palmerin, S., Frazier, P. I., & Wilson, A. G. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1903.04703 · Cited by 77
PREDICTD PaRallel Epigenomics Data Imputation with Cloud-based Tensor Decomposition
Durham, T., Libbrecht, M. W., Howbert, J. J., Bilmes, J., & Noble, W. S. (2018) · Nature Communications · doi:10.1038/s41467-018-03635-9 · Cited by 74
Han, J.-H., Choi, D.-J., Park, S.-U., & Hong, S.-K. (2020) · Journal of Electrical Engineering and Technology · doi:10.1007/s42835-020-00343-7 · Cited by 76
Yang, Y., & Chui, T. F. M. (2021) · Hydrology and earth system sciences · doi:10.5194/hess-25-5839-2021 · Cited by 81
Han, Y., Shen, L., & Sun, C. T. (2021) · Building and Environment · doi:10.1016/j.buildenv.2021.107932 · Cited by 76
Dao, P. D., He, Y., & Proctor, C. (2021) · International Journal of Applied Earth Observation and Geoinformation · doi:10.1016/j.jag.2021.102364 · Cited by 76
Developing a Ship Collision Risk Index estimation model based on Dempster-Shafer theory
Abebe, M., Noh, Y., Seo, C., Kim, D., & Lee, I. (2021) · Applied Ocean Research · doi:10.1016/j.apor.2021.102735 · Cited by 76
Trehern, W., Ortiz-Ayala, R., Atli, K. C., Arróyave, R., & Karaman, İ. (2022) · Acta Materialia · doi:10.1016/j.actamat.2022.117751 · Cited by 80
Novel Ensemble Tree Solution for Rockburst Prediction Using Deep Forest
Li, D., Liu, Z., Armaghani, D. J., Xiao, P., & Zhou, J. (2022) · Mathematics · doi:10.3390/math10050787 · Cited by 76
He, C., Zhang, C., Bian, T., Jiao, K., Su, W., Wu, K., & Su, A. (2023) · Processes · doi:10.3390/pr11020330 · Cited by 88
Predictive Entropy Search for Multi-objective Bayesian Optimization with Constraints
Garrido‐Merchán, E. C., & Hernández-Lobato, D. (2019) · Neurocomputing · doi:10.1016/j.neucom.2019.06.025 · Cited by 76
A case for efficient accelerator design space exploration via Bayesian optimization
Reagen, B., Hernández-Lobato, J. M., Adolf, R., Gelbart, M. A., Whatmough, P. N., Wei, G.-Y., & Brooks, D. M. (2017) · International Symposium on Low Power Electronics and Design (ISLPED) · doi:10.1109/islped.2017.8009208 · Cited by 76
On the Potential of Simple Framewise Approaches to Piano TranscriptionPreprint
Kelz, R., Dorfer, M., Korzeniowski, F., Böck, S., Arzt, A., & Widmer, G. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1612.05153 · Cited by 90
MOBOpt — multi-objective Bayesian optimization
Galuzio, P. P., Segundo, E. H. D. V., Coelho, L. D. S., & Mariani, V. C. (2020) · SoftwareX · doi:10.1016/j.softx.2020.100520 · Cited by 76
Model-free detection and tracking of dynamic objects with 2D lidar
Wang, D. Z., Posner, I., & Newman, P. (2015) · The International Journal of Robotics Research · doi:10.1177/0278364914562237 · Cited by 73
Hossain, S. M. Z., Sultana, N., Razzak, S. A., & Hossain, M. M. (2022) · Renewable and Sustainable Energy Reviews · doi:10.1016/j.rser.2021.112016 · Cited by 75
Deep Neural Networks for ECG-Based Pulse Detection during Out-of-Hospital Cardiac Arrest
Elola, A., Aramendi, E., Irusta, U., Picón, A., Alonso, E., Owens, P. C., & Idris, A. H. (2019) · Entropy · doi:10.3390/e21030305 · Cited by 74
Grekousis, G., & Liu, Y. (2019) · Computers Environment and Urban Systems · doi:10.1016/j.compenvurbsys.2019.04.006 · Cited by 76
Chen, B., Wu, H., Mo, W., Chattopadhyay, I., & Lipson, H. (2018) · Genetic and Evolutionary Computation Conference (GECCO) · doi:10.1145/3205455.3205586 · Cited by 80
A machine learning-based multiscale model to predict bone formation in scaffolds
Wu, C., Entezari, A., Zheng, K., Fang, J., Zreiqat, H., Steven, G. P., Swain, M. V., & Li, Q. (2021) · Nature Computational Science · doi:10.1038/s43588-021-00115-x · Cited by 77
Estimating key traffic state parameters through parsimonious spatial queue models
Cheng, Q., Liu, Z., Guo, J., Wu, X., Pendyala, R. M., Belezamo, B., & Zhou, X. (2022) · Transportation Research Part C Emerging Technologies · doi:10.1016/j.trc.2022.103596 · Cited by 75
Nill, L., Grünberg, I., Ullmann, T., Geßner, M., Boike, J., & Hostert, P. (2022) · Remote Sensing of Environment · doi:10.1016/j.rse.2022.113228 · Cited by 75
Asrav, T., & Aydın, E. (2023) · Computers & Chemical Engineering · doi:10.1016/j.compchemeng.2023.108195 · Cited by 78
On the effects of data normalization for domain adaptation on EEG data
Apicella, A., Isgrò, F., Pollastro, A., & Prevete, R. (2023) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2023.106205 · Cited by 79
Neuroforecasting of daily streamflows in the UK for short- and medium-term horizons: A novel insight
Granata, F., & Nunno, F. D. (2023) · Journal of Hydrology · doi:10.1016/j.jhydrol.2023.129888 · Cited by 78
Application of Machine Learning for Optimization of 3-D Integrated Circuits and Systems
Park, S. J., Bae, B., Kim, J., & Swaminathan, M. (2017) · IEEE Transactions on Very Large Scale Integration (VLSI) Systems · doi:10.1109/tvlsi.2017.2656843 · Cited by 75
Bayesian optimization for accelerated drug discovery
Pyzer‐Knapp, E. O. (2018) · IBM Journal of Research and Development · doi:10.1147/jrd.2018.2881731 · Cited by 77
Hyperparameter Optimization: A Spectral ApproachPreprint
Hazan, E., Klivans, A. R., & Yang, Y. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1706.00764 · Cited by 107
Bayesian Multi-Scale Optimistic OptimizationPreprint
Wang, Z., Shakibi, B., Lin, J., & de Freitas, N. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1402.7005 · Cited by 77
A Survey of Deep Learning Applications to Autonomous Vehicle Control
Kuutti, S., Bowden, R., Jin, Y., Barber, P., & Fallah, S. (2021) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2019.2962338 · Cited by 96
Effective hyperparameter optimization using Nelder-Mead method in deep learning
Ozaki, Y., Masaki, Y., & Onishi, M. (2017) · IPSJ Transactions on Computer Vision and Applications · doi:10.1186/s41074-017-0030-7 · Cited by 81
Lovrić, M., Pavlović, K., Žuvela, P., Spataru, A., Lučić, B., Kern, R., & Wong, M. W. (2021) · Journal of Chemometrics · doi:10.1002/cem.3349 · Cited by 73
XGBoost Regression of the Most Significant Photoplethysmogram Features for Assessing Vascular Aging
Shin, H. (2022) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2022.3151091 · Cited by 81
Lee, S., Park, J., Kim, N., Lee, T., & Quagliato, L. (2023) · Materials & Design · doi:10.1016/j.matdes.2023.111625 · Cited by 74
Ye, G., Wan, J., Deng, Z., Wang, Y., Chen, J., Zhu, B., & Ji, S. (2024) · Bioresource Technology · doi:10.1016/j.biortech.2024.130361 · Cited by 74
Causal feature learning: an overview
Chalupka, K., Eberhardt, F., & Perona, P. (2016) · Behaviormetrika · doi:10.1007/s41237-016-0008-2 · Cited by 82
Learning deep facial expression features from image and optical flow sequences using 3D CNN
Zhao, J., Mao, X., & Zhang, J. (2018) · The Visual Computer · doi:10.1007/s00371-018-1477-y · Cited by 75
Uncertainty-Aware Search Framework for Multi-Objective Bayesian Optimization
Belakaria, S., Deshwal, A., Jayakodi, N. K., & Doppa, J. R. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i06.6561 · Cited by 76
Deep learning for pH prediction in water desalination using membrane capacitive deionization
Son, M., Yoon, N., Jeong, K., Abbas, A., Logan, B. E., & Cho, K. H. (2021) · Desalination · doi:10.1016/j.desal.2021.115233 · Cited by 75
Bayesian Optimization in High-Dimensional Spaces: A Brief Survey
Malu, M., Dasarathy, G., & Spanias, A. (2021) · International Conference on Information, Intelligence, Systems & Applications (IISA) · doi:10.1109/iisa52424.2021.9555522 · Cited by 73
Deep learning in target prediction and drug repositioning: Recent advances and challenges
Yu, J., Dai, Q.-Q., & Li, G. (2021) · Drug Discovery Today · doi:10.1016/j.drudis.2021.10.010 · Cited by 74
Physics-Informed Recurrent Neural Networks for Soft Pneumatic Actuators
Sun, W., Akashi, N., Kuniyoshi, Y., & Nakajima, K. (2022) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2022.3178496 · Cited by 73
Li, J., Zhang, X., Zhou, Q., Chan, F. T. S., & Hu, Z. Y. (2022) · Journal of Manufacturing Processes · doi:10.1016/j.jmapro.2022.10.050 · Cited by 74
Designing Engaging Games Using Bayesian Optimization
Khajah, M. M., Roads, B. D., Lindsey, R., Liu, Y.-E., & Mozer, M. C. (2016) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/2858036.2858253 · Cited by 78
Beyond Globally Optimal: Focused Learning for Improved Recommendations
Beutel, A., Chi, E. H., Cheng, Z., Pham, H., & Anderson, J. (2017) · Proceedings of the 26th International Conference on World Wide Web · doi:10.1145/3038912.3052713 · Cited by 73
Bayesian Optimization for Neuroimaging Pre-processing in Brain Age Classification and Prediction
Lancaster, J., Lorenz, R., Leech, R., & Cole, J. H. (2018) · Frontiers in Aging Neuroscience · doi:10.3389/fnagi.2018.00028 · Cited by 73
Hyperparameter Optimization for Deep Reinforcement Learning in Vehicle Energy Management
Ließner, R., Schmitt, J., Dietermann, A., & Bäker, B. (2019) · International Conference on Agents and Artificial Intelligence (ICAART) · doi:10.5220/0007364701340144 · Cited by 73
Spoofing detection with DNN and one-class SVM for the ASVspoof 2015 challenge
Villalba, J., Miguel, A., Ortega, A., & Lleida, E. (2015) · Interspeech 2015 · doi:10.21437/interspeech.2015-468 · Cited by 72
Strided Convolution Instead of Max Pooling for Memory Efficiency of Convolutional Neural Networks
Ayachi, R., Afif, M., Said, Y., & Atri, M. (2019) · Smart innovation, systems and technologies · doi:10.1007/978-3-030-21005-2_23 · Cited by 73
Choi, J., Park, S., & Ahn, J. (2020) · Scientific Reports · doi:10.1038/s41598-020-58821-x · Cited by 72
Sorourifar, F., Makrygirgos, G., Mesbah, A., & Paulson, J. A. (2021) · IFAC-PapersOnLine · doi:10.1016/j.ifacol.2021.08.249 · Cited by 72
Jiang, Z., Hu, J., Tong, M., Samia, A. C. S., Zhang, H. J., & Yu, X. B. (2021) · Catalysts · doi:10.3390/catal11091107 · Cited by 72
Weighted Random Search for CNN Hyperparameter Optimization
Andonie, R., & Florea, A.-C. (2020) · International Journal of Computers Communications & Control · doi:10.15837/ijccc.2020.2.3868 · Cited by 72
Ha, J., Jeon, H., Han, D. S., Seo, J., & Oh, C. (2024) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642472 · Cited by 96
Learning the Curriculum with Bayesian Optimization for Task-Specific Word Representation Learning
Tsvetkov, Y., Faruqui, M., Wang, L., MacWhinney, B., & Dyer, C. (2016) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p16-1013 · Cited by 86
Dalibard, V., Schaarschmidt, M., & Yoneki, E. (2017) · International World Wide Web Conference (WWW) · doi:10.1145/3038912.3052662 · Cited by 72
Improving reference prioritisation with PICO recognition.
Brockmeier, A. J., Ju, M., Przybyła, P., & Ananiadou, S. (2019) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-019-0992-8 · Cited by 62
Comparative Study of Hybrid Artificial Intelligence Approaches for Predicting Hangingwall Stability
Qi, C., Fourie, A. B., Ma, G., Tang, X., & Du, X. (2017) · Journal of Computing in Civil Engineering · doi:10.1061/(asce)cp.1943-5487.0000737 · Cited by 73
Segmenting brain tumors from FLAIR MRI using fully convolutional neural networks
Lorenzo, P. R., Nalepa, J., Bobek‐Billewicz, B., Wawrzyniak, P., Mrukwa, G., Kawulok, M., Ulrych, P., & Hayball, M. P. (2019) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2019.05.006 · Cited by 71
Hyperparameter optimization in black-box image processing using differentiable proxies
Tseng, E., Yu, F., Yang, Y., Mannan, F., Arnaud, K. S., Nowrouzezahrai, D., Lalonde, J., & Heide, F. (2019) · ACM Transactions on Graphics · doi:10.1145/3306346.3322996 · Cited by 73
Dual Metric Learning for Effective and Efficient Cross-Domain Recommendations
Pan, L., & Tuzhilin, A. (2021) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2021.3074395 · Cited by 74
Identifying material parameters in crystal plasticity by Bayesian optimization
Kuhn, J., Spitz, J., Sonnweber–Ribic, P., Schneider, M., & Böhlke, T. (2021) · Optimization and Engineering · doi:10.1007/s11081-021-09663-7 · Cited by 74
Metadata
- Authors
- Snoek, J., Larochelle, H., & Adams, R. P.
- Affiliations
- University of Toronto (CA)
- Université de Sherbrooke (CA)
- Harvard University (US)
- ORCID
- Adams, Ryan P.
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2012
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1206.2944
- OpenAlex
- W2131241448
- Cited by
- 6,691
- References
- 23
- Citations by year
- 2026: 62 · 2025: 630 · 2024: 779 · 2023: 712 · 2022: 720 · 2021: 997 · 2020: 864 · 2019: 680 · 2018: 465 · 2017: 289 · 2016: 212 · 2015: 144 · 2014: 94 · 2013: 34 · 2012: 9
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- Digital Access to Scholarship at Harvard (DASH) (Harvard University) (submittedVersion, cc-by)
- arXiv (Cornell University)
- Funders
- Defense Advanced Research Projects Agency
- Natural Sciences and Engineering Research Council of Canada
- Topics
- Social Sciences › Decision Sciences › Management Science and Operations Research › Advanced Bandit Algorithms Research
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning and Data Classification
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning and Algorithms
- Keywords
- Bayesian optimization, hyperparameter optimization, Gaussian process priors, latent Dirichlet allocation, structured support vector machines, convolutional neural networks
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
