SMAC3: A Versatile Bayesian Optimization Package for Hyperparameter Optimization
Open accessAbstract
Algorithm parameters, in particular hyperparameters of machine learning algorithms, can substantially impact their performance. To support users in determining well-performing hyperparameter configurations for their algorithms, datasets and applications at hand, SMAC3 offers a robust and flexible framework for Bayesian Optimization, which can improve performance within a few evaluations. It offers several facades and pre-sets for typical use cases, such as optimizing hyperparameters, solving low dimensional continuous (artificial) global optimization problems and configuring algorithms to perform well across multiple problem instances. The SMAC3 package is available under a permissive BSD-license at https://github.com/automl/SMAC3.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Recent studies have shown that other optimisation algorithms are suitable for the AutoMoDe family, including simulated annealing and sequential model-based algorithm configuration.
“Recent studies have shown that other optimisation algorithms are suitable for the AutoMoDe family (e.g., simulated annealing 65 and sequential model-based algorithm configuration 66,67 ).”
From Automatic design of stigmergy-based behaviours for robot swarms (2024) · cites this paper as [67]
Section 2.4 (p. 3) describes SMAC as an algorithm-configuration optimizer, supporting the citation’s identification of that method. The paper does not report a study of the AutoMoDe family or establish that SMAC is suitable for it; the application-specific part of the claim is unsupported. (LLM, conf=0.84)
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Breiman, L. (2001) · Machine Learning · doi:10.1023/a:1010933404324 · Cited by 133,538 · see citing works
Efficient Global Optimization of Expensive Black-Box Functions
Jones, D. R., Schonlau, M., & Welch, W. J. (1998) · Journal of Global Optimization · doi:10.1023/a:1008306431147 · Cited by 8,070 · see citing works
(2012) · Cited by 8,009 · see citing works
Practical Bayesian Optimization of Machine Learning Algorithms
Snoek, J., Larochelle, H., & Adams, R. P. (2012) · arXiv · doi:10.48550/arxiv.1206.2944 · Cited by 6,691 · see citing works
Taking the Human Out of the Loop: A Review of Bayesian Optimization
Shahriari, B., Swersky, K., Wang, Z., Adams, R. P., & de Freitas, N. (2015) · Proceedings of the IEEE · doi:10.1109/jproc.2015.2494218 · Cited by 6,195 · see citing works
THOMPSON, W. R. (1933) · Biometrika · doi:10.1093/biomet/25.3-4.285 · Cited by 2,712 · see citing works
Sequential Model-Based Optimization for General Algorithm Configuration
Hutter, F., Hoos, H. H., & Leyton-Brown, K. (2011) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-25566-3_40 · Cited by 2,469 · see citing works
Self-citationInformation-Theoretic Regret Bounds for Gaussian Process Optimization in the Bandit Setting
Srinivas, N., Krause, A., Kakade, S. M., & Seeger, M. (2012) · IEEE Transactions on Information Theory · doi:10.48550/arxiv.0912.3995 · Cited by 2,100 · see citing works
The irace package: Iterated racing for automatic algorithm configuration
López-Ibáñez, M., Dubois-Lacoste, J., Pérez Cáceres, L., Birattari, M., & Stützle, T. (2016) · Operations Research Perspectives · doi:10.1016/j.orp.2016.09.002 · Cited by 1,761 · see citing works
DEAP: evolutionary algorithms made easy
Fortin, F.-A., Rainville, F.-M. D., Gardner, M.-A., Parizeau, M., & Gagné, C. (2012) · Cited by 1,690 · see citing works
Auto-WEKA: combined selection and hyperparameter optimization of classification algorithms
Thornton, C., Hutter, F., Hoos, H. H., & Leyton-Brown, K. (2013) · Proceedings of the 19th ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/2487575.2487629 · Cited by 1,359 · see citing works
Self-citation(2015) · neural information processing systems · Cited by 1,305 · see citing works
Self-citationHyperband: a novel bandit-based approach to hyperparameter optimization
Li, L., Jamieson, K., DeSalvo, G., Rostamizadeh, A., & Talwalkar, A. (2017) · Journal of Machine Learning Research · Cited by 930 · see citing works
ParamILS: An Automatic Algorithm Configuration Framework
Hutter, F., Hoos, H. H., Leyton‐Brown, K., & Stützle, T. (2009) · Journal of Artificial Intelligence Research · doi:10.1613/jair.2861 · Cited by 883 · see citing works
Self-citationDask: Parallel Computation with Blocked algorithms and Task Scheduling
Rocklin, M. (2015) · Proceedings of the Python in Science Conferences · doi:10.25080/majora-7b98e3ed-013 · Cited by 815 · see citing works
Hyperopt: A Python Library for Optimizing the Hyperparameters of Machine Learning Algorithms
Bergstra, J., Yamins, D., & Cox, D. (2013) · Proceedings of the Python in Science Conferences · doi:10.25080/majora-8b375195-003 · Cited by 784 · see citing works
Evaluation of a Tree-based Pipeline Optimization Tool for Automating Data Science
Olson, R. S., Bartley, N., Urbanowicz, R. J., & Moore, J. H. (2016) · Genetic and Evolutionary Computation Conference (GECCO) · doi:10.1145/2908812.2908918 · Cited by 630 · see citing works
BoTorch: A Framework for Efficient Monte-Carlo Bayesian OptimizationPreprint
Balandat, M., Karrer, B., Jiang, D., Daulton, S., Letham, B., Wilson, A. G., & Bakshy, E. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1910.06403 · Cited by 527 · see citing works
A Gender-Based Genetic Algorithm for the Automatic Configuration of Algorithms
Ansótegui, C., Sellmann, M., & Tierney, K. (2009) · Lecture notes in computer science · doi:10.1007/978-3-642-04244-7_14 · Cited by 307 · see citing works
Scalable Global Optimization via Local Bayesian OptimizationPreprint
Eriksson, D., Pearce, M., Gardner, J. R., Turner, R., & Poloczek, M. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1910.01739 · Cited by 271 · see citing works
CMA-ES for Hyperparameter Optimization of Deep Neural NetworksPreprint
Loshchilov, I., & Hutter, F. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1604.07269 · Cited by 228 · see citing works
Self-citationAuto-Pytorch: Multi-Fidelity MetaLearning for Efficient and Robust AutoDL
Zimmer, L., Lindauer, M., & Hutter, F. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2021.3067763 · Cited by 190 · see citing works
Self-citationPortfolio allocation for Bayesian optimization
Hoffman, M. D., Brochu, E., & de Freitas, N. (2011) · Cited by 159 · see citing works
Time efficiency in optimization with a bayesian-Evolutionary algorithm
Lan, G., Tomczak, J. M., Roijers, D. M., & Eiben, A. E. (2021) · Swarm and Evolutionary Computation · doi:10.1016/j.swevo.2021.100970 · Cited by 83 · see citing works
Practical Design Space Exploration
Nardi, L., Koeplinger, D., & Olukotun, K. (2019) · Proceedings - International Symposium on Modeling, Analysis, and Simulation of Computer and Telecommunication Systems · doi:10.1109/mascots.2019.00045 · Cited by 78 · see citing works
OpenBox: A Generalized Black-box Optimization Service
Li, Y., Shen, Y., Zhang, W., Chen, Y., Jiang, H., Liu, M., Jiang, J., Gao, J., Wu, W., Yang, Z., et al. (2021) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3447548.3467061 · Cited by 77 · see citing works
Time-Bounded Sequential Parameter Optimization
Hutter, F., Hoos, H. H., Leyton‐Brown, K., & Murphy, K. (2010) · Lecture notes in computer science · doi:10.1007/978-3-642-13800-3_30 · Cited by 76 · see citing works
Self-citationNAS-Bench-1Shot1: Benchmarking and Dissecting One-shot Neural Architecture SearchPreprint
Zela, A., Siems, J., & Hutter, F. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2001.10422 · Cited by 74 · see citing works
Self-citationThe Configurable SAT Solver Challenge (CSSC)
Hutter, F., Lindauer, M., Balint, A., Bayless, S., Hoos, H. H., & Leyton‐Brown, K. (2016) · Artificial Intelligence · doi:10.1016/j.artint.2016.09.006 · Cited by 69 · see citing works
Self-citationDEHB: Evolutionary Hyberband for Scalable, Robust and Efficient Hyperparameter Optimization
Awad, N. H., Mallik, N., & Hutter, F. (2021) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2021/296 · Cited by 56 · see citing works
Self-citationDynamic Algorithm Configuration: Foundation of a New Meta-Algorithmic Framework
André, B., Furkan, B. H., Eimer, T., Frank, H., & Lindauer, M. (2020) · Frontiers in artificial intelligence and applications · doi:10.3233/faia200122 · Cited by 44 · see citing works
Self-citationTabular Benchmarks for Joint Architecture and Hyperparameter OptimizationPreprint
Klein, A., & Hutter, F. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1905.04970 · Cited by 31 · see citing works
Self-citationTowards Assessing the Impact of Bayesian Optimization's Own HyperparametersPreprint
Lindauer, M., Feurer, M., Eggensperger, K., Biedenkapp, A., & Hutter, F. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1908.06674 · Cited by 10 · see citing works
Self-citationSquirrel: A Switching Hyperparameter OptimizerPreprint
Awad, N. H., Shala, G., Deng, D., Mallik, N., Feurer, M., Eggensperger, K., Biedenkapp, A., Vermetten, D., Wang, H., Doerr, C., et al. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2012.08180 · Cited by 3 · see citing works
Self-citation
Flagged first, then by citations
4 of the 38 references couldn’t be matched to a known paper.
Research works printed but not linked: 10
- E. Bakshy, L. Dworkin, B. Karrer, K. Kashin, B. Letham, A. Murthy, and S. Singh. Ae: A domain-agnostic platform for adaptive experimentation. In Proceedings of the international conference on Neural Information Processing Systems , pages 1-8, 2018.
- K. Eggensperger, P. M¨ uller, N. Malik, M. Feurer, R. Sass, A. Klein, N. Awad, Marius Lindauer, and Frank Hutter. HPOBench: A collection of reproducible multi-fidelity benchmark problems for hpo. In Proceedings of the Neural Information Processing Systems Track on Datasets and Benchmarks , 2021.
- S. Falkner, A. Klein, and F. Hutter. BOHB: Robust and efficient hyperparameter optimization at scale. In J. Dy and A. Krause, editors, Proceedings of the 35th International Conference on Machine Learning (ICML'18) , volume 80, pages 1437-1446. Proceedings of Machine Learning Research, 2018.
- M. Feurer and F. Hutter. Hyperparameter optimization. In F. Hutter, L. Kotthoff, and J. Vanschoren, editors, Automated Machine Learning: Methods, Systems, Challenges , volume 5 of The Springer Series on Challenges in Machine Learning , chapter 1, pages 3-38. Springer, 2019. Available for free at http://automl.org/book.
- K. Kandasamy, K. Vysyaraju, W. Neiswanger, B. Paria, C. Collins, J. Schneider, B. Poczos, and E. Xing. Tuning hyperparameters without grad students: Scalable and robust Bayesian optimisation with Dragonfly. Journal of Machine Learning Research , 21(81): 1-27, 2020.
- M. Lindauer, K. Eggensperger, M. Feurer, A. Biedenkapp, J. Marben, P. M¨ uller, and F. Hutter. BOAH: A Tool Suite for Multi-Fidelity Bayesian Optimization & Analysis of Hyperparameters. arXiv:1908.06756 [cs.LG] , 2019a. · arXiv
- J. Mockus, V. Tiesis, and A. Zilinskas. The application of Bayesian methods for seeking the extremum. Towards Global Optimization , 2(117-129), 1978.
- N. Srinivas, A. Krause, S. Kakade, and M. Seeger. Gaussian process optimization in the bandit setting: No regret and experimental design. In J. F¨ urnkranz and T. Joachims, editors, Proceedings of the 27th International Conference on Machine Learning (ICML'10) , pages 1015-1022. Omnipress, 2010.
- R. Turner, D. Eriksson, M. McCourt, J. Kiili, E. Laaksonen, Z. Xu, and I. Guyon. Bayesian optimization is superior to random search for machine learning hyperparameter tuning: Analysis of the black-box optimization challenge 2020. In H. Escalante and K. Hofmann, editors, NeurIPS 2020 Competition and Demonstration Track , volume 133 of Proceedings of Machine Learning Research , pages 3-26. PMLR, 2020.
- A. Zela, T. Elsken, T. Saikia, Y. Marrakchi, T. Brox, and F. Hutter. Understanding and robustifying differentiable architecture search. In Proceedings of the International Conference on Learning Representations (ICLR'20) , 2020. Published online: iclr.cc .
Cited by
Sorted by citations
Hyperparameter optimization: Foundations, algorithms, best practices, and open challenges
Bischl, B., Binder, M., Lang, M., Pielok, T., Richter, J., Coors, S., Thomas, J., Ullmann, T., Becker, M., Boulesteix, A., et al. (2023) · Wiley Interdisciplinary Reviews Data Mining and Knowledge Discovery · doi:10.1002/widm.1484 · Cited by 1,118 · see citing works
Self-citationSelf-Driving Laboratories for Chemistry and Materials Science
Tom, G., Schmid, S. P., Baird, S. G., Cao, Y., Darvish, K., Hao, H., Lo, S., Pablo-García, S., Rajaonson, E. M., Skreta, M., et al. (2024) · Chemical Reviews · doi:10.1021/acs.chemrev.4c00055 · Cited by 707 · see citing works
A systematic review of hyperparameter optimization techniques in Convolutional Neural Networks
Raiaan, M. A. K., Sakib, S., Fahad, N. M., Mamun, A. A., Rahman, M. A., Shatabda, S., & Mukta, M. S. H. (2024) · Decision Analytics Journal · doi:10.1016/j.dajour.2024.100470 · Cited by 308 · see citing works
Amin, M. M., Cambria, E., & Schuller, B. W. (2023) · IEEE Intelligent Systems · doi:10.1109/mis.2023.3254179 · Cited by 162 · see citing works
An improved hyperparameter optimization framework for AutoML systems using evolutionary algorithms
Vincent, A. M., & Jidesh, P. (2023) · Scientific Reports · doi:10.1038/s41598-023-32027-3 · Cited by 157 · see citing works
Saves, P., Lafage, R., Bartoli, N., Diouane, Y., Bussemaker, J., Lefebvre, T., Hwang, J. T. T., Morlier, J., & Martins, J. R. R. A. (2023) · Advances in Engineering Software · doi:10.1016/j.advengsoft.2023.103571 · Cited by 136 · see citing works
NAS-PINN: Neural architecture search-guided physics-informed neural network for solving PDEs
Wang, Y., & Zhong, L. (2023) · Journal of Computational Physics · doi:10.1016/j.jcp.2023.112603 · Cited by 112 · see citing works
Efficient Methods for Natural Language Processing: A Survey
Treviso, M., Lee, J.-U., Ji, T., van Aken, B., Cao, Q., Ciosici, M. R., Hassid, M., Heafield, K., Hooker, S., Raffel, C., et al. (2023) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00577 · Cited by 124 · see citing works
Evolutionary Algorithms for Parameter Optimization—Thirty Years Later
Bäck, T., Kononova, A. V., van Stein, B., Wang, H., Antonov, K., Kalkreuth, R., de Nobel, J., Vermetten, D., de Winter, R., & Ye, F. (2023) · Evolutionary Computation · doi:10.1162/evco_a_00325 · Cited by 87 · see citing works
Hyperparameter Tuning for Machine and Deep Learning with R
Bartz, E., Bartz–Beielstein, T., Zaefferer, M., & Mersmann, O. (2022) · Springer eBooks · doi:10.1007/978-981-19-5170-1 · Cited by 92 · see citing works
Neural architecture search: A contemporary literature review for computer vision applications
Poyser, M., & Breckon, T. P. (2023) · Pattern Recognition · doi:10.1016/j.patcog.2023.110052 · Cited by 82 · see citing works
Slideflow: deep learning for digital histopathology with real-time whole-slide visualization
Dolezal, J. M., Kochanny, S. E., Dyer, E., Ramesh, S., Srisuwananukorn, A., Sacco, M., Howard, F. M., Li, A., Mohan, P., & Pearson, A. T. (2024) · BMC Bioinformatics · doi:10.1186/s12859-024-05758-x · Cited by 67 · see citing works
GPTuner: A Manual-Reading Database Tuning System via GPT-Guided Bayesian Optimization
Lao, J., Wang, Y., Li, Y., Wang, J., Zhang, Y., Cheng, Z., Chen, W., Tang, M., & Wang, J. (2024) · Proceedings of the VLDB Endowment · doi:10.14778/3659437.3659449 · Cited by 73 · see citing works
Cambria, E., Zhang, X., Mao, R., Chen, M., & Kwok, K. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-76827-9_11 · Cited by 59 · see citing works
The drone-assisted pickup and delivery problem: An adaptive large neighborhood search metaheuristic
Mulumba, T., Najy, W., & Diabat, A. H. (2023) · Computers & Operations Research · doi:10.1016/j.cor.2023.106435 · Cited by 54 · see citing works
Atlas: a brain for self-driving laboratories
Hickman, R. J., Sim, M., Pablo‐García, S., Tom, G., Woolhouse, I., Hao, H., Bao, Z., Bannigan, P., Allen, C. J., Aldeghi, M., et al. (2025) · Digital Discovery · doi:10.1039/d4dd00115j · Cited by 56 · see citing works
SR-Forest: A Genetic Programming-Based Heterogeneous Ensemble Learning Method
Zhang, H., Zhou, A., Chen, Q., Xue, B., & Zhang, M. (2023) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2023.3243172 · Cited by 50 · see citing works
Improving the Robustness and Quality of Biomedical CNN Models through Adaptive Hyperparameter Tuning
Iqbal, S., Qureshi, A. N., Ullah, A., Li, J., & Mahmood, T. (2022) · Applied Sciences · doi:10.3390/app122211870 · Cited by 48 · see citing works
Automated Dynamic Algorithm Configuration
Adriænsen, S., Biedenkapp, A., Shala, G., Awad, N. H., Eimer, T., Lindauer, M., & Hutter, F. (2022) · Journal of Artificial Intelligence Research · doi:10.1613/jair.1.13922 · Cited by 46 · see citing works
Self-citationGADMA2: more efficient and flexible demographic inference from genetic data
Noskova, E., Abramov, N., Iliutkin, S., Sidorin, A. V., Dobrynin, P. V., & Игоревич, У. В. (2022) · GigaScience · doi:10.1093/gigascience/giad059 · Cited by 40 · see citing works
Learn to optimize—a brief overview
Tang, K., & Yao, X. (2024) · National Science Review · doi:10.1093/nsr/nwae132 · Cited by 35 · see citing works
Regression-Based Hyperparameter Learning for Support Vector Machines
Peng, S., Wang, W., Chen, Y., Zhong, X., & Hu, Q. (2023) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2023.3321685 · Cited by 30 · see citing works
Auto-Tuning Dynamics Parameters of Intelligent Electric Vehicles via Bayesian Optimization
Wang, Y., Lian, R., He, H., Betz, J., & Wei, H. (2023) · IEEE Transactions on Transportation Electrification · doi:10.1109/tte.2023.3346874 · Cited by 30 · see citing works
HPOBench: A Collection of Reproducible Multi-Fidelity Benchmark Problems for HPOPreprint
Eggensperger, K., Müller, P., Mallik, N., Feurer, M., Sass, R., Klein, A., Awad, N. H., Lindauer, M., & Hutter, F. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2109.06716 · Cited by 42 · see citing works
Self-citationA Survey on Sustainable Surrogate-Based Optimisation
Bliek, L. (2022) · Sustainability · doi:10.3390/su14073867 · Cited by 28 · see citing works
Automatic design of stigmergy-based behaviours for robot swarms
Salman, M., Garzón Ramos, D., & Birattari, M. (2024) · Communications Engineering · doi:10.1038/s44172-024-00175-7 · Cited by 26 · see citing works
Automated broad transfer learning for cross-domain fault diagnosis
Liu, G., Shen, W., Gao, L., & Kusiak, A. (2022) · Journal of Manufacturing Systems · doi:10.1016/j.jmsy.2022.11.003 · Cited by 26 · see citing works
In-the-loop Hyper-Parameter Optimization for LLM-Based Automated Design of Heuristics
van Stein, B., Vermetten, D., & Bäck, T. (2025) · ACM Transactions on Evolutionary Learning and Optimization · doi:10.1145/3731567 · Cited by 24 · see citing works
A data-aware explainable deep learning approach for next activity prediction
Aversano, L., Bernardi, M. L., Cimitile, M., Iammarino, M., & Verdone, C. (2023) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2023.106758 · Cited by 24 · see citing works
Can ChatGPT’s Responses Boost Traditional Natural Language Processing?
Amin, M. M., Cambria, E., & Schuller, B. W. (2023) · IEEE Intelligent Systems · doi:10.1109/mis.2023.3305861 · Cited by 24 · see citing works
Online Control of Adaptive Large Neighborhood Search Using Deep Reinforcement Learning
Reijnen, R., Zhang, Y., Lau, H. C., & Bukhsh, Z. A. (2024) · Proceedings of the International Conference on Automated Planning and Scheduling · doi:10.1609/icaps.v34i1.31507 · Cited by 26 · see citing works
Benchmarking Feature-Based Algorithm Selection Systems for Black-Box Numerical Optimization
Tanabe, R. (2022) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2022.3169770 · Cited by 21 · see citing works
Machine Learning for Cutting Planes in Integer Programming: A Survey
Deza, A., & Khalil, E. B. (2023) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2023/739 · Cited by 21 · see citing works
Machine Learning Strategies to Tackle Data Challenges in Mass Spectrometry-Based Proteomics
Dens, C., Adams, C., Laukens, K., & Bittremieux, W. (2024) · Journal of the American Society for Mass Spectrometry · doi:10.1021/jasms.4c00180 · Cited by 21 · see citing works
Efficient Automated Deep Learning for Time Series Forecasting
Deng, D., Karl, F., Hutter, F., Bischl, B., & Lindauer, M. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-26409-2_40 · Cited by 20 · see citing works
Self-citationLi, D., Zhang, Z., Zhou, L., Liu, P., Wang, Z., & Deng, J. (2022) · Applied Energy · doi:10.1016/j.apenergy.2022.119703 · Cited by 19 · see citing works
Adaptive Cut Selection in Mixed-Integer Linear Programming
Turner, M., Koch, T., Serrano, F., & Winkler, M. (2023) · Open Journal of Mathematical Optimization · doi:10.5802/ojmo.25 · Cited by 19 · see citing works
Accelerated Design for Perovskite-Oxide-Based Photocatalysts Using Machine Learning Techniques
Zhai, X., & Chen, M. (2024) · Materials · doi:10.3390/ma17123026 · Cited by 18 · see citing works
Guindani, B., Ardagna, D., Guglielmi, A., Rocco, R., & Palermo, G. (2024) · IEEE Transactions on Cloud Computing · doi:10.1109/tcc.2024.3361070 · Cited by 17 · see citing works
Benchmarking Optimization Algorithms for Auto-Tuning GPU Kernels
Schoonhoven, R., van Werkhoven, B., & Batenburg, K. J. (2022) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2022.3210654 · Cited by 17 · see citing works
Kim, Y.-H., Doo, H., Shin, D., Lee, S. Y., Roh, Y., Park, S., Song, H., Jung, Y., Yoo, H. J., Han, S. S., et al. (2025) · Computers & Chemical Engineering · doi:10.1016/j.compchemeng.2025.109266 · Cited by 21 · see citing works
ExTrEMO: Transfer Evolutionary Multiobjective Optimization With Proof of Faster Convergence
Liu, J., Gupta, A., Ooi, C. C., & Ong, Y.-S. (2024) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2023.3349313 · Cited by 16 · see citing works
Rau, K., Eggensperger, K., Schneider, F., Hennig, P., & Scholten, T. (2024) · The Science of The Total Environment · doi:10.1016/j.scitotenv.2024.173720 · Cited by 17 · see citing works
Self-citationAutoML for multi-class anomaly compensation of sensor drift
Schaller, M., Kruse, M., Ortega, A., Lindauer, M., & Rosenhahn, B. (2025) · Measurement · doi:10.1016/j.measurement.2025.117097 · Cited by 15 · see citing works
Self-citationPED-ANOVA: Efficiently Quantifying Hyperparameter Importance in Arbitrary Subspaces
Watanabe, S., Bansal, A., & Hutter, F. (2023) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2023/488 · Cited by 15 · see citing works
Self-citationNeuralBO: A black-box optimization algorithm using deep neural networks
Phan-Trong, D., Tran-The, H., & Gupta, S. (2023) · Neurocomputing · doi:10.1016/j.neucom.2023.126776 · Cited by 15 · see citing works
Barcode demultiplexing of nanopore sequencing raw signals by unsupervised machine learning
Papetti, D. M., Spolaor, S., Nazari, I., Tirelli, A., Leonardi, T., Caprioli, C., Besozzi, D., Vlachou, T., Pelicci, P. G., Cazzaniga, P., et al. (2023) · Frontiers in Bioinformatics · doi:10.3389/fbinf.2023.1067113 · Cited by 14 · see citing works
Yang, H., Liu, Z., Li, Y., Wei, H., & Huang, N. (2023) · Applied Sciences · doi:10.3390/app13095418 · Cited by 14 · see citing works
Zhang, M., & Mahdi, W. A. (2023) · Case Studies in Thermal Engineering · doi:10.1016/j.csite.2023.103268 · Cited by 14 · see citing works
TransBO: Hyperparameter Optimization via Two-Phase Transfer Learning
Li, Y., Shen, Y., Jiang, H., Zhang, W., Yang, Z. C., Zhang, C., & Cui, B. (2022) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3534678.3539255 · Cited by 14 · see citing works
Tian, X., Wang, J., Kim, C., Deng, X., & Zhu, Y.-J. (2025) · Engineering Structures · doi:10.1016/j.engstruct.2025.119884 · Cited by 13 · see citing works
Addressing the Algorithm Selection Problem through an Attention-Based Meta-Learner Approach
de León-Hicks, E. D., Conant-Pablos, S. E., Ortíz-Bayliss, J. C., & Terashima‐Marín, H. (2023) · Applied Sciences · doi:10.3390/app13074601 · Cited by 13 · see citing works
Denkena, B., Dittrich, M.-A., Noske, H., Lange, D., Benjamins, C., & Lindauer, M. (2023) · The International Journal of Advanced Manufacturing Technology · doi:10.1007/s00170-023-11524-9 · Cited by 13 · see citing works
Self-citationLarge-State Reinforcement Learning for Hyper-Heuristics
Kletzander, L., & Musliu, N. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i10.26466 · Cited by 13 · see citing works
Automated Machine Learning for Remaining Useful Life Predictions
Zöller, M.-A., Mauthe, F., Zeiler, P., Lindauer, M., & Huber, M. F. (2023) · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/smc53992.2023.10394031 · Cited by 13 · see citing works
Self-citationBeBOP - Combining Reactive Planning and Bayesian Optimization to Solve Robotic Manipulation Tasks
Styrud, J., Mayr, M., Hellsten, E., Krueger, V., & Smith, C. (2024) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra57147.2024.10611468 · Cited by 13 · see citing works
Miguel, J. P. M., Neves, L. A., Martins, A. S., do Nascimento, M. Z., & Tosta, T. A. A. (2023) · Expert Systems with Applications · doi:10.1016/j.eswa.2023.120609 · Cited by 13 · see citing works
Hyperparameter Tuning MLP’s for Probabilistic Time Series Forecasting
Madhusudhanan, K., Jawed, S., & Schmidt-Thieme, L. (2024) · Lecture notes in computer science · doi:10.1007/978-981-97-2266-2_21 · Cited by 13 · see citing works
Universitas Islam Neger Syekh Ali Hasan Ahmad Addary Padangsidimpuan, S. U., & Hardana, A. (2023) · Jurnal Akuntansi Keuangan dan Manajemen · doi:10.35912/jakman.v4i4.2300 · Cited by 13 · see citing works
Rippa, M., Schulze, R., Kenyon, G., Himstedt, M., KWIATKOWSKI, M. K., Grobholz, R., Wyler, S. F., Cornelius, A., Schindera, S. T., & Burn, F. (2024) · Diagnostics · doi:10.3390/diagnostics14151677 · Cited by 12 · see citing works
Hu, N., Shu, K., Zhang, Y., Alfonso, L., Li, C., & Zheng, T. (2025) · Water Research · doi:10.1016/j.watres.2025.123768 · Cited by 12 · see citing works
Massively Parallel Genetic Optimization Through Asynchronous Propagation of Populations
Taubert, O., Weiel, M., Coquelin, D., Farshian, A., Debus, C., Schug, A. H., Streit, A., & Götz, M. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-32041-5_6 · Cited by 12 · see citing works
Automatically-Tuned Model Predictive Control for an Underwater Soft Robot
Null, W. D., Edwards, W., Jeong, D., Tchalakov, T., Menezes, J., Hauser, K. K., & Zhang, Y. (2023) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2023.3333662 · Cited by 12 · see citing works
Search-based Methods for Multi-Cloud Configuration
Lazuka, M., Parnell, T. P., Anghel, A., & Pozidis, H. (2022) · IEEE ... International Conference on Cloud Computing · doi:10.1109/cloud55607.2022.00067 · Cited by 12 · see citing works
BayesO: A Bayesian optimization framework in Python
Kim, J., & Choi, S. (2023) · The Journal of Open Source Software · doi:10.21105/joss.05320 · Cited by 11 · see citing works
Automated algorithm selection using meta-learning and pre-trained deep convolution neural networks
Dagan, I., Vainshtein, R., Katz, G., & Rokach, L. (2023) · Information Fusion · doi:10.1016/j.inffus.2023.102210 · Cited by 11 · see citing works
TUNA: Tuning Unstable and Noisy Cloud Applications
Freischuetz, J., Kanellis, K., Kroth, B., & Venkataraman, S. (2025) · European Conference on Computer Systems · doi:10.1145/3689031.3717480 · Cited by 11 · see citing works
Untrained and Unmatched: Fast and Accurate Zero-Training Classification for Tabular Engineering Data
Picard, C., & Ahmed, F. (2024) · Journal of Mechanical Design · doi:10.1115/1.4064811 · Cited by 11 · see citing works
Wu, H., Zhang, Y., Lu, D., Gong, X., Lei, L., Zhang, H., Liu, Y., & Wang, Q. (2024) · Materials & Design · doi:10.1016/j.matdes.2024.113360 · Cited by 10 · see citing works
Robust prior-biased acquisition function for human-in-the-loop Bayesian optimization
Hottin, R. G., Kardassevitch, L., Pham, H., Lajoie, G., & Bonizzato, M. (2025) · Knowledge-Based Systems · doi:10.1016/j.knosys.2025.113039 · Cited by 10 · see citing works
Ge, Y., Li, Z., Yuan, Z., Wang, Z., Yan, B., Tao, J., Zhou, S., & Chen, G. (2025) · Bioresource Technology · doi:10.1016/j.biortech.2025.133071 · Cited by 10 · see citing works
Transfer Learning based Search Space Design for Hyperparameter Tuning
Li, Y., Shen, Y., Jiang, H., Bai, T., Zhang, W., Zhang, C., & Cui, B. (2022) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3534678.3539369 · Cited by 10 · see citing works
An efficient hyper-parameter optimization method for supervised learning
Shi, Y., Qi, H., Qi, X., & Mu, X. (2022) · Applied Soft Computing · doi:10.1016/j.asoc.2022.109266 · Cited by 10 · see citing works
Schneider, L., Bischl, B., & Thomas, J. (2023) · Genetic and Evolutionary Computation Conference (GECCO) · doi:10.1145/3583131.3590380 · Cited by 10 · see citing works
Boosted multilayer feedforward neural network with multiple output layers
Aly, H., Al-Ali, A. K., & Suganthan, P. N. (2024) · Pattern Recognition · doi:10.1016/j.patcog.2024.110740 · Cited by 9 · see citing works
Buratto, W. G., Muniz, R. N., Nied, A., Barros, C. F. D. O., Finardi, E. C., & González, G. V. (2025) · International Journal of Electrical Power & Energy Systems · doi:10.1016/j.ijepes.2025.111199 · Cited by 9 · see citing works
Hickman, R. J., Parakh, P., Cheng, A., Ai, Q., Schrier, J., Aldeghi, M., & Aspuru‐Guzik, A. (2023) · ChemRxiv · doi:10.26434/chemrxiv-2023-74w8d · Cited by 9 · see citing works
Generating Cheap Representative Functions for Expensive Automotive Crashworthiness Optimization
Long, F. X., van Stein, B., Frenzel, M. A., Krause, P., Gitterle, M., & Bäck, T. (2024) · ACM Transactions on Evolutionary Learning and Optimization · doi:10.1145/3646554 · Cited by 8 · see citing works
The Value of Hyperparameter Optimization in Phase-Picking Neural Networks
Park, Y., & Shelly, D. R. (2024) · The Seismic Record · doi:10.1785/0320240025 · Cited by 8 · see citing works
Practitioner Motives to Use Different Hyperparameter Optimization Methods
Kannengießer, N., Hasebrook, N., Morsbach, F., Zöller, M.-A., Franke, J. K. H., Lindauer, M., Hutter, F., & Sunyaev, A. (2025) · ACM Transactions on Computer-Human Interaction · doi:10.1145/3745771 · Cited by 8 · see citing works
Self-citationSBArchOpt: Surrogate-Based Architecture Optimization
Bussemaker, J. (2023) · The Journal of Open Source Software · doi:10.21105/joss.05564 · Cited by 8 · see citing works
A multi-objective optimization framework for reducing the impact of ship noise on marine mammals
Venkateshwaran, A., Deo, I. K., Jelovica, J., & Jaiman, R. K. (2024) · Ocean Engineering · doi:10.1016/j.oceaneng.2024.118687 · Cited by 7 · see citing works
Hybrid training of deep neural networks with multiple output layers for tabular data classification
Hamdy, M., Al-Ali, A. K., Suganthan, P. N., & Aly, H. (2025) · Pattern Recognition · doi:10.1016/j.patcog.2025.112035 · Cited by 7 · see citing works
Fan, Z., Ghaddar, B., Wang, X., Xing, L., Zhang, Y. A., & Zhou, Z. (2025) · European Journal of Operational Research · doi:10.1016/j.ejor.2025.08.029 · Cited by 26 · see citing works
Using Reinforcement Learning for Per-Instance Algorithm Configuration on the TSP
Seiler, M. V., Rook, J., Heins, J., Preuß, O. L., Bossek, J., & Trautmann, H. (2023) · IEEE Symposium Series on Computational Intelligence (SSCI) · doi:10.1109/ssci52147.2023.10372008 · Cited by 7 · see citing works
Shang, R., Liu, H., Li, W., Zhang, W., Ma, T., & Jiao, L. (2024) · Swarm and Evolutionary Computation · doi:10.1016/j.swevo.2024.101520 · Cited by 7 · see citing works
Bresich, M., Raidl, G. R., & Limmer, S. (2024) · Genetic and Evolutionary Computation Conference (GECCO) · doi:10.1145/3638529.3654057 · Cited by 7 · see citing works
Metaheuristic algorithms for the bus driver scheduling problem with complex break constraints
Kletzander, L., Mazzoli, T. M., & Musliu, N. (2022) · Genetic and Evolutionary Computation Conference (GECCO) · doi:10.1145/3512290.3528876 · Cited by 7 · see citing works
Automatic MILP solver configuration by learning problem similarities
Hosny, A., & Reda, S. (2023) · Annals of Operations Research · doi:10.1007/s10479-023-05508-x · Cited by 7 · see citing works
FPIA: Field-Programmable Ising Arrays with In-Memory Computing
Hutchinson, G. H., Sifferman, E., Bhattacharya, T., Kwon, D., & Strukov, D. B. (2024) · International Symposium on Low Power Electronics and Design (ISLPED) · doi:10.1145/3665314.3670851 · Cited by 7 · see citing works
Enhancing a Hierarchical Evolutionary Strategy Using the Nearest-Better Clustering
Guzowski, H., Smółka, M., & Pekař, L. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-63759-9_43 · Cited by 6 · see citing works
GEDI: Generating Event Data with Intentional Features for Benchmarking Process Mining
Maldonado, A., Frey, C. M. M., Tavares, G. M., Rehwald, N., & Seidl, T. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-70396-6_13 · Cited by 6 · see citing works
Ahrari, A., & Verstraete, D. (2023) · Swarm and Evolutionary Computation · doi:10.1016/j.swevo.2023.101357 · Cited by 6 · see citing works
Bayesian Optimization Meets Self-Distillation
Lee, H., Song, H., Lee, H., Lee, G., Park, S., & Yoo, D. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00163 · Cited by 6 · see citing works
Interactive Hyperparameter Optimization in Multi-Objective Problems via Preference Learning
Giovanelli, J., Tornede, A., Tornede, T., & Lindauer, M. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i11.29106 · Cited by 6 · see citing works
Self-citationTransfer Learning of Surrogate Models via Domain Affine Transformation
Pan, S., Vermetten, D., López‐Ibáñez, M., Bäck, T., & Wang, H. (2024) · Genetic and Evolutionary Computation Conference (GECCO) · doi:10.1145/3638529.3654032 · Cited by 6 · see citing works
Introducing LensKit-Auto, an Experimental Automated Recommender System (AutoRecSys) Toolkit
Vente, T., Ekstrand, M. D., & Beel, J. (2023) · ACM Conference on Recommender Systems (RecSys) · doi:10.1145/3604915.3610656 · Cited by 6 · see citing works
Hyperparameter optimization of two-branch neural networks in multi-target prediction
Iliadis, D., Wever, M., Bernard De Baets, C., & Waegeman, W. (2024) · Applied Soft Computing · doi:10.1016/j.asoc.2024.111957 · Cited by 6 · see citing works
van Stein, B., Kononova, A. V., Yin, H., & Bäck, T. (2025) · Genetic and Evolutionary Computation Conference Companion (GECCO Companion) · doi:10.1145/3712255.3734347 · Cited by 5 · see citing works
Generative Design of a Gas Turbine Combustor Using Invertible Neural Networks
Krueger, P. P., Gottschalk, H., Werdelmann, B., & Krebs, W. (2024) · Journal of Engineering for Gas Turbines and Power · doi:10.1115/1.4066294 · Cited by 5 · see citing works
- Authors
- Lindauer, M., Eggensperger, K., Feurer, M., Biedenkapp, A., Deng, D., Benjamins, C., Ruhopf, T., Sass, R., & Hutter, F.
- Affiliations
- Leibniz University Hannover (DE)
- University of Freiburg (DE)
- ORCID
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2021
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 2109.09831
- OpenAlex
- W3199199693
- Cited by
- 195
- References
- 38
- Citations by year
- 2026: 1 · 2025: 46 · 2024: 60 · 2023: 64 · 2022: 22 · 2021: 2
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Funders
- European Commission
- Deutsche Forschungsgemeinschaft (INST 37/935-1, 37/935-1, INST~37/935-1 FUGG, 37/935-1 FUGG)
- Eberhard Karls Universität Tübingen
- Generalitat de Catalunya (10.13039/501100011033, 13039/501100011033, 501100011033, AEI/10.13039/501100011033, MCIN /AEI/10.13039/501100011033, PID2019)
- Agència de Gestió d'Ajuts Universitaris i de Recerca (AEI/10.13039/501100011033, MCIN/AEI/10.13039/501100011033/, 10.13039/501100011033, 13039/501100011033)
- Agencia Estatal de Investigación (AEI//10.13039/501100011033/, 501100011033, 10.13039/501100011033, MCIN/AEI/10.13039/501 100 011 033, 13039, .13039/501100011033, MCIN / AEI/10, 10.13039, PID2019-109137GB-C21, AEI/10, PID2019)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning and Data Classification
- Social Sciences › Decision Sciences › Management Science and Operations Research › Advanced Bandit Algorithms Research
- Physical Sciences › Computer Science › Artificial Intelligence › Metaheuristic Optimization Algorithms Research
- Keywords
- Bayesian optimization, hyperparameter optimization, automated machine learning, global optimization, multi-fidelity optimization, algorithm configuration, hyperparameter search
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
