PreprintCited by 196Machine Learning and Data ClassificationAdvanced Bandit Algorithms ResearchMetaheuristic Optimization Algorithms Research

The DOI matches its DataCite record; 34 of the 38 references it cites were found in a registry or an index.

SMAC3: A Versatile Bayesian Optimization Package for Hyperparameter Optimization

Open access

Lindauer, Marius, Eggensperger, Katharina, Feurer, Matthias, Biedenkapp, André, Deng, Difan, Benjamins, Carolin, Ruhopf, Tim, Sass, René, Hutter, Frank·2021·arXiv

DOI 10.48550/arxiv.2109.09831arXiv 2109.09831

Open this paper in CoChat — free account Open PDF

Abstract

Algorithm parameters, in particular hyperparameters of machine learning algorithms, can substantially impact their performance. To support users in determining well-performing hyperparameter configurations for their algorithms, datasets and applications at hand, SMAC3 offers a robust and flexible framework for Bayesian Optimization, which can improve performance within a few evaluations. It offers several facades and pre-sets for typical use cases, such as optimizing hyperparameters, solving low dimensional continuous (artificial) global optimization problems and configuring algorithms to perform well across multiple problem instances. The SMAC3 package is available under a permissive BSD-license at https://github.com/automl/SMAC3.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

Integrity signals

Registry

DataCite · 10.48550/arxiv.2109.09831

Cites

34 of 34 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Random Forests
Breiman, L. (2001) · Machine Learning · doi:10.1023/a:1010933404324 · Cited by 133,538
Efficient Global Optimization of Expensive Black-Box Functions
Jones, D. R., Schonlau, M., & Welch, W. J. (1998) · Journal of Global Optimization · doi:10.1023/a:1008306431147 · Cited by 8,070
Untitled work
(2012) · Cited by 8,009
Practical Bayesian Optimization of Machine Learning Algorithms
Snoek, J., Larochelle, H., & Adams, R. P. (2012) · arXiv · doi:10.48550/arxiv.1206.2944 · Cited by 6,691
Taking the Human Out of the Loop: A Review of Bayesian Optimization
Shahriari, B., Swersky, K., Wang, Z., Adams, R. P., & de Freitas, N. (2015) · Proceedings of the IEEE · doi:10.1109/jproc.2015.2494218 · Cited by 6,195
ON THE LIKELIHOOD THAT ONE UNKNOWN PROBABILITY EXCEEDS ANOTHER IN VIEW OF THE EVIDENCE OF TWO SAMPLES
THOMPSON, W. R. (1933) · Biometrika · doi:10.1093/biomet/25.3-4.285 · Cited by 2,712
Sequential Model-Based Optimization for General Algorithm Configuration
Hutter, F., Hoos, H. H., & Leyton-Brown, K. (2011) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-25566-3_40 · Cited by 2,469
Self-citation
Information-Theoretic Regret Bounds for Gaussian Process Optimization in the Bandit Setting
Srinivas, N., Krause, A., Kakade, S. M., & Seeger, M. (2012) · IEEE Transactions on Information Theory · doi:10.48550/arxiv.0912.3995 · Cited by 2,100
The irace package: Iterated racing for automatic algorithm configuration
López-Ibáñez, M., Dubois-Lacoste, J., Pérez Cáceres, L., Birattari, M., & Stützle, T. (2016) · Operations Research Perspectives · doi:10.1016/j.orp.2016.09.002 · Cited by 1,761
DEAP: evolutionary algorithms made easy
Fortin, F.-A., Rainville, F.-M. D., Gardner, M.-A., Parizeau, M., & Gagné, C. (2012) · Cited by 1,690

Show all 38 references

Research works printed but not linked: 10

E. Bakshy, L. Dworkin, B. Karrer, K. Kashin, B. Letham, A. Murthy, and S. Singh. Ae: A domain-agnostic platform for adaptive experimentation. In Proceedings of the international conference on Neural Information Processing Systems , pages 1-8, 2018.
K. Eggensperger, P. M¨ uller, N. Malik, M. Feurer, R. Sass, A. Klein, N. Awad, Marius Lindauer, and Frank Hutter. HPOBench: A collection of reproducible multi-fidelity benchmark problems for hpo. In Proceedings of the Neural Information Processing Systems Track on Datasets and Benchmarks , 2021.
S. Falkner, A. Klein, and F. Hutter. BOHB: Robust and efficient hyperparameter optimization at scale. In J. Dy and A. Krause, editors, Proceedings of the 35th International Conference on Machine Learning (ICML'18) , volume 80, pages 1437-1446. Proceedings of Machine Learning Research, 2018.
M. Feurer and F. Hutter. Hyperparameter optimization. In F. Hutter, L. Kotthoff, and J. Vanschoren, editors, Automated Machine Learning: Methods, Systems, Challenges , volume 5 of The Springer Series on Challenges in Machine Learning , chapter 1, pages 3-38. Springer, 2019. Available for free at http://automl.org/book.
K. Kandasamy, K. Vysyaraju, W. Neiswanger, B. Paria, C. Collins, J. Schneider, B. Poczos, and E. Xing. Tuning hyperparameters without grad students: Scalable and robust Bayesian optimisation with Dragonfly. Journal of Machine Learning Research , 21(81): 1-27, 2020.
M. Lindauer, K. Eggensperger, M. Feurer, A. Biedenkapp, J. Marben, P. M¨ uller, and F. Hutter. BOAH: A Tool Suite for Multi-Fidelity Bayesian Optimization & Analysis of Hyperparameters. arXiv:1908.06756 [cs.LG] , 2019a. · arXiv
J. Mockus, V. Tiesis, and A. Zilinskas. The application of Bayesian methods for seeking the extremum. Towards Global Optimization , 2(117-129), 1978.
N. Srinivas, A. Krause, S. Kakade, and M. Seeger. Gaussian process optimization in the bandit setting: No regret and experimental design. In J. F¨ urnkranz and T. Joachims, editors, Proceedings of the 27th International Conference on Machine Learning (ICML'10) , pages 1015-1022. Omnipress, 2010.
R. Turner, D. Eriksson, M. McCourt, J. Kiili, E. Laaksonen, Z. Xu, and I. Guyon. Bayesian optimization is superior to random search for machine learning hyperparameter tuning: Analysis of the black-box optimization challenge 2020. In H. Escalante and K. Hofmann, editors, NeurIPS 2020 Competition and Demonstration Track , volume 133 of Proceedings of Machine Learning Research , pages 3-26. PMLR, 2020.
A. Zela, T. Elsken, T. Saikia, Y. Marrakchi, T. Brox, and F. Hutter. Understanding and robustifying differentiable architecture search. In Proceedings of the International Conference on Learning Representations (ICLR'20) , 2020. Published online: iclr.cc .

Sorted by citations

Hyperparameter optimization: Foundations, algorithms, best practices, and open challenges
Bischl, B., Binder, M., Lang, M., Pielok, T., Richter, J., Coors, S., Thomas, J., Ullmann, T., Becker, M., Boulesteix, A., et al. (2023) · Wiley Interdisciplinary Reviews Data Mining and Knowledge Discovery · doi:10.1002/widm.1484 · Cited by 1,262
Self-citation
Self-Driving Laboratories for Chemistry and Materials Science
Tom, G., Schmid, S. P., Baird, S. G., Cao, Y., Darvish, K., Hao, H., Lo, S., Pablo-García, S., Rajaonson, E. M., Skreta, M., et al. (2024) · Chemical Reviews · doi:10.1021/acs.chemrev.4c00055 · Cited by 707
A systematic review of hyperparameter optimization techniques in Convolutional Neural Networks
Raiaan, M. A. K., Sakib, S., Fahad, N. M., Mamun, A. A., Rahman, M. A., Shatabda, S., & Mukta, M. S. H. (2024) · Decision Analytics Journal · doi:10.1016/j.dajour.2024.100470 · Cited by 341
Will Affective Computing Emerge From Foundation Models and General Artificial Intelligence? A First Evaluation of ChatGPT
Amin, M. M., Cambria, E., & Schuller, B. W. (2023) · IEEE Intelligent Systems · doi:10.1109/mis.2023.3254179 · Cited by 162
An improved hyperparameter optimization framework for AutoML systems using evolutionary algorithms
Vincent, A. M., & Jidesh, P. (2023) · Scientific Reports · doi:10.1038/s41598-023-32027-3 · Cited by 188
SMT 2.0: A Surrogate Modeling Toolbox with a focus on hierarchical and mixed variables Gaussian processes
Saves, P., Lafage, R., Bartoli, N., Diouane, Y., Bussemaker, J., Lefebvre, T., Hwang, J. T. T., Morlier, J., & Martins, J. R. R. A. (2023) · Advances in Engineering Software · doi:10.1016/j.advengsoft.2023.103571 · Cited by 136
NAS-PINN: Neural architecture search-guided physics-informed neural network for solving PDEs
Wang, Y., & Zhong, L. (2023) · Journal of Computational Physics · doi:10.1016/j.jcp.2023.112603 · Cited by 112
Efficient Methods for Natural Language Processing: A Survey
Treviso, M., Lee, J.-U., Ji, T., van Aken, B., Cao, Q., Ciosici, M. R., Hassid, M., Heafield, K., Hooker, S., Raffel, C., et al. (2023) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00577 · Cited by 156
Evolutionary Algorithms for Parameter Optimization—Thirty Years Later
Bäck, T., Kononova, A. V., van Stein, B., Wang, H., Antonov, K., Kalkreuth, R., de Nobel, J., Vermetten, D., de Winter, R., & Ye, F. (2023) · Evolutionary Computation · doi:10.1162/evco_a_00325 · Cited by 104
Hyperparameter Tuning for Machine and Deep Learning with R
Bartz, E., Bartz–Beielstein, T., Zaefferer, M., & Mersmann, O. (2022) · Springer eBooks · doi:10.1007/978-981-19-5170-1 · Cited by 115
Neural architecture search: A contemporary literature review for computer vision applications
Poyser, M., & Breckon, T. P. (2023) · Pattern Recognition · doi:10.1016/j.patcog.2023.110052 · Cited by 82
Slideflow: deep learning for digital histopathology with real-time whole-slide visualization
Dolezal, J. M., Kochanny, S. E., Dyer, E., Ramesh, S., Srisuwananukorn, A., Sacco, M., Howard, F. M., Li, A., Mohan, P., & Pearson, A. T. (2024) · BMC Bioinformatics · doi:10.1186/s12859-024-05758-x · Cited by 86
GPTuner: A Manual-Reading Database Tuning System via GPT-Guided Bayesian Optimization
Lao, J., Wang, Y., Li, Y., Wang, J., Zhang, Y., Cheng, Z., Chen, W., Tang, M., & Wang, J. (2024) · Proceedings of the VLDB Endowment · doi:10.14778/3659437.3659449 · Cited by 73
SenticNet 8: Fusing Emotion AI and Commonsense AI for Interpretable, Trustworthy, and Explainable Affective Computing
Cambria, E., Zhang, X., Mao, R., Chen, M., & Kwok, K. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-76827-9_11 · Cited by 62
The drone-assisted pickup and delivery problem: An adaptive large neighborhood search metaheuristic
Mulumba, T., Najy, W., & Diabat, A. H. (2023) · Computers & Operations Research · doi:10.1016/j.cor.2023.106435 · Cited by 54
Atlas: a brain for self-driving laboratories
Hickman, R. J., Sim, M., Pablo‐García, S., Tom, G., Woolhouse, I., Hao, H., Bao, Z., Bannigan, P., Allen, C. J., Aldeghi, M., et al. (2025) · Digital Discovery · doi:10.1039/d4dd00115j · Cited by 63
SR-Forest: A Genetic Programming-Based Heterogeneous Ensemble Learning Method
Zhang, H., Zhou, A., Chen, Q., Xue, B., & Zhang, M. (2023) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2023.3243172 · Cited by 50
Improving the Robustness and Quality of Biomedical CNN Models through Adaptive Hyperparameter Tuning
Iqbal, S., Qureshi, A. N., Ullah, A., Li, J., & Mahmood, T. (2022) · Applied Sciences · doi:10.3390/app122211870 · Cited by 48
Automated Dynamic Algorithm Configuration
Adriænsen, S., Biedenkapp, A., Shala, G., Awad, N. H., Eimer, T., Lindauer, M., & Hutter, F. (2022) · Journal of Artificial Intelligence Research · doi:10.1613/jair.1.13922 · Cited by 59
Self-citation
GADMA2: more efficient and flexible demographic inference from genetic data
Noskova, E., Abramov, N., Iliutkin, S., Sidorin, A. V., Dobrynin, P. V., & Игоревич, У. В. (2022) · GigaScience · doi:10.1093/gigascience/giad059 · Cited by 40
Learn to optimize—a brief overview
Tang, K., & Yao, X. (2024) · National Science Review · doi:10.1093/nsr/nwae132 · Cited by 41
Regression-Based Hyperparameter Learning for Support Vector Machines
Peng, S., Wang, W., Chen, Y., Zhong, X., & Hu, Q. (2023) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2023.3321685 · Cited by 30
Auto-Tuning Dynamics Parameters of Intelligent Electric Vehicles via Bayesian Optimization
Wang, Y., Lian, R., He, H., Betz, J., & Wei, H. (2023) · IEEE Transactions on Transportation Electrification · doi:10.1109/tte.2023.3346874 · Cited by 30
HPOBench: A Collection of Reproducible Multi-Fidelity Benchmark Problems for HPOPreprint
Eggensperger, K., Müller, P., Mallik, N., Feurer, M., Sass, R., Klein, A., Awad, N. H., Lindauer, M., & Hutter, F. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2109.06716 · Cited by 82
Self-citation
A Survey on Sustainable Surrogate-Based Optimisation
Bliek, L. (2022) · Sustainability · doi:10.3390/su14073867 · Cited by 32
Automatic design of stigmergy-based behaviours for robot swarms
Salman, M., Garzón Ramos, D., & Birattari, M. (2024) · Communications Engineering · doi:10.1038/s44172-024-00175-7 · Cited by 26
Automated broad transfer learning for cross-domain fault diagnosis
Liu, G., Shen, W., Gao, L., & Kusiak, A. (2022) · Journal of Manufacturing Systems · doi:10.1016/j.jmsy.2022.11.003 · Cited by 26
In-the-loop Hyper-Parameter Optimization for LLM-Based Automated Design of Heuristics
van Stein, B., Vermetten, D., & Bäck, T. (2025) · ACM Transactions on Evolutionary Learning and Optimization · doi:10.1145/3731567 · Cited by 44
A data-aware explainable deep learning approach for next activity prediction
Aversano, L., Bernardi, M. L., Cimitile, M., Iammarino, M., & Verdone, C. (2023) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2023.106758 · Cited by 24
Can ChatGPT’s Responses Boost Traditional Natural Language Processing?
Amin, M. M., Cambria, E., & Schuller, B. W. (2023) · IEEE Intelligent Systems · doi:10.1109/mis.2023.3305861 · Cited by 30
Online Control of Adaptive Large Neighborhood Search Using Deep Reinforcement Learning
Reijnen, R., Zhang, Y., Lau, H. C., & Bukhsh, Z. A. (2024) · Proceedings of the International Conference on Automated Planning and Scheduling · doi:10.1609/icaps.v34i1.31507 · Cited by 26
Benchmarking Feature-Based Algorithm Selection Systems for Black-Box Numerical Optimization
Tanabe, R. (2022) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2022.3169770 · Cited by 21
Machine Learning for Cutting Planes in Integer Programming: A Survey
Deza, A., & Khalil, E. B. (2023) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2023/739 · Cited by 21
Machine Learning Strategies to Tackle Data Challenges in Mass Spectrometry-Based Proteomics
Dens, C., Adams, C., Laukens, K., & Bittremieux, W. (2024) · Journal of the American Society for Mass Spectrometry · doi:10.1021/jasms.4c00180 · Cited by 21
Efficient Automated Deep Learning for Time Series Forecasting
Deng, D., Karl, F., Hutter, F., Bischl, B., & Lindauer, M. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-26409-2_40 · Cited by 25
Self-citation
Multi-time-step and multi-parameter prediction for real-world proton exchange membrane fuel cell vehicles (PEMFCVs) toward fault prognosis and energy consumption prediction
Li, D., Zhang, Z., Zhou, L., Liu, P., Wang, Z., & Deng, J. (2022) · Applied Energy · doi:10.1016/j.apenergy.2022.119703 · Cited by 19
Adaptive Cut Selection in Mixed-Integer Linear Programming
Turner, M., Koch, T., Serrano, F., & Winkler, M. (2023) · Open Journal of Mathematical Optimization · doi:10.5802/ojmo.25 · Cited by 19
Accelerated Design for Perovskite-Oxide-Based Photocatalysts Using Machine Learning Techniques
Zhai, X., & Chen, M. (2024) · Materials · doi:10.3390/ma17123026 · Cited by 18
Integrating Bayesian Optimization and Machine Learning for the Optimal Configuration of Cloud Systems
Guindani, B., Ardagna, D., Guglielmi, A., Rocco, R., & Palermo, G. (2024) · IEEE Transactions on Cloud Computing · doi:10.1109/tcc.2024.3361070 · Cited by 17
Benchmarking Optimization Algorithms for Auto-Tuning GPU Kernels
Schoonhoven, R., van Werkhoven, B., & Batenburg, K. J. (2022) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2022.3210654 · Cited by 23
Self-driving laboratories with artificial intelligence: An overview of process systems engineering perspective
Kim, Y.-H., Doo, H., Shin, D., Lee, S. Y., Roh, Y., Park, S., Song, H., Jung, Y., Yoo, H. J., Han, S. S., et al. (2025) · Computers & Chemical Engineering · doi:10.1016/j.compchemeng.2025.109266 · Cited by 23
ExTrEMO: Transfer Evolutionary Multiobjective Optimization With Proof of Faster Convergence
Liu, J., Gupta, A., Ooi, C. C., & Ong, Y.-S. (2024) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2023.3349313 · Cited by 16
How can we quantify, explain, and apply the uncertainty of complex soil maps predicted with neural networks?
Rau, K., Eggensperger, K., Schneider, F., Hennig, P., & Scholten, T. (2024) · The Science of The Total Environment · doi:10.1016/j.scitotenv.2024.173720 · Cited by 17
Self-citation
AutoML for multi-class anomaly compensation of sensor drift
Schaller, M., Kruse, M., Ortega, A., Lindauer, M., & Rosenhahn, B. (2025) · Measurement · doi:10.1016/j.measurement.2025.117097 · Cited by 15
Self-citation
PED-ANOVA: Efficiently Quantifying Hyperparameter Importance in Arbitrary Subspaces
Watanabe, S., Bansal, A., & Hutter, F. (2023) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2023/488 · Cited by 15
Self-citation
NeuralBO: A black-box optimization algorithm using deep neural networks
Phan-Trong, D., Tran-The, H., & Gupta, S. (2023) · Neurocomputing · doi:10.1016/j.neucom.2023.126776 · Cited by 15
Barcode demultiplexing of nanopore sequencing raw signals by unsupervised machine learning
Papetti, D. M., Spolaor, S., Nazari, I., Tirelli, A., Leonardi, T., Caprioli, C., Besozzi, D., Vlachou, T., Pelicci, P. G., Cazzaniga, P., et al. (2023) · Frontiers in Bioinformatics · doi:10.3389/fbinf.2023.1067113 · Cited by 14
CatBoost–Bayesian Hybrid Model Adaptively Coupled with Modified Theoretical Equations for Estimating the Undrained Shear Strength of Clay
Yang, H., Liu, Z., Li, Y., Wei, H., & Huang, N. (2023) · Applied Sciences · doi:10.3390/app13095418 · Cited by 14
Development of SVM-based machine learning model for estimating lornoxicam solubility in supercritical solvent
Zhang, M., & Mahdi, W. A. (2023) · Case Studies in Thermal Engineering · doi:10.1016/j.csite.2023.103268 · Cited by 14
TransBO: Hyperparameter Optimization via Two-Phase Transfer Learning
Li, Y., Shen, Y., Jiang, H., Zhang, W., Yang, Z. C., Zhang, C., & Cui, B. (2022) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3534678.3539255 · Cited by 17
Automated machine learning exact dirichlet boundary physics-informed neural networks for solid mechanics
Tian, X., Wang, J., Kim, C., Deng, X., & Zhu, Y.-J. (2025) · Engineering Structures · doi:10.1016/j.engstruct.2025.119884 · Cited by 13
Addressing the Algorithm Selection Problem through an Attention-Based Meta-Learner Approach
de León-Hicks, E. D., Conant-Pablos, S. E., Ortíz-Bayliss, J. C., & Terashima‐Marín, H. (2023) · Applied Sciences · doi:10.3390/app13074601 · Cited by 13
Application of machine learning for fleet-based condition monitoring of ball screw drives in machine tools
Denkena, B., Dittrich, M.-A., Noske, H., Lange, D., Benjamins, C., & Lindauer, M. (2023) · The International Journal of Advanced Manufacturing Technology · doi:10.1007/s00170-023-11524-9 · Cited by 13
Self-citation
Large-State Reinforcement Learning for Hyper-Heuristics
Kletzander, L., & Musliu, N. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i10.26466 · Cited by 13
Automated Machine Learning for Remaining Useful Life Predictions
Zöller, M.-A., Mauthe, F., Zeiler, P., Lindauer, M., & Huber, M. F. (2023) · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/smc53992.2023.10394031 · Cited by 13
Self-citation
BeBOP - Combining Reactive Planning and Bayesian Optimization to Solve Robotic Manipulation Tasks
Styrud, J., Mayr, M., Hellsten, E., Krueger, V., & Smith, C. (2024) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra57147.2024.10611468 · Cited by 13
Analysis of neural networks trained with evolutionary algorithms for the classification of breast cancer histological images
Miguel, J. P. M., Neves, L. A., Martins, A. S., do Nascimento, M. Z., & Tosta, T. A. A. (2023) · Expert Systems with Applications · doi:10.1016/j.eswa.2023.120609 · Cited by 13
Hyperparameter Tuning MLP’s for Probabilistic Time Series Forecasting
Madhusudhanan, K., Jawed, S., & Schmidt-Thieme, L. (2024) · Lecture notes in computer science · doi:10.1007/978-981-97-2266-2_21 · Cited by 13
Pengaruh Struktur Kepemilikan terhadap Nilai Perusahaan dengan Kinerja Keuangan dan Kebijakan Hutang sebagai Variabel Intervening
Universitas Islam Neger Syekh Ali Hasan Ahmad Addary Padangsidimpuan, S. U., & Hardana, A. (2023) · Jurnal Akuntansi Keuangan dan Manajemen · doi:10.35912/jakman.v4i4.2300 · Cited by 13
Evaluation of Machine Learning Classification Models for False-Positive Reduction in Prostate Cancer Detection Using MRI Data
Rippa, M., Schulze, R., Kenyon, G., Himstedt, M., KWIATKOWSKI, M. K., Grobholz, R., Wyler, S. F., Cornelius, A., Schindera, S. T., & Burn, F. (2024) · Diagnostics · doi:10.3390/diagnostics14151677 · Cited by 12
Prediction of natural runoff in China based on multi-scenario climate models with self-attention neural networks
Hu, N., Shu, K., Zhang, Y., Alfonso, L., Li, C., & Zheng, T. (2025) · Water Research · doi:10.1016/j.watres.2025.123768 · Cited by 12
Massively Parallel Genetic Optimization Through Asynchronous Propagation of Populations
Taubert, O., Weiel, M., Coquelin, D., Farshian, A., Debus, C., Schug, A. H., Streit, A., & Götz, M. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-32041-5_6 · Cited by 12
Automatically-Tuned Model Predictive Control for an Underwater Soft Robot
Null, W. D., Edwards, W., Jeong, D., Tchalakov, T., Menezes, J., Hauser, K. K., & Zhang, Y. (2023) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2023.3333662 · Cited by 12
Search-based Methods for Multi-Cloud Configuration
Lazuka, M., Parnell, T. P., Anghel, A., & Pozidis, H. (2022) · IEEE ... International Conference on Cloud Computing · doi:10.1109/cloud55607.2022.00067 · Cited by 12
BayesO: A Bayesian optimization framework in Python
Kim, J., & Choi, S. (2023) · The Journal of Open Source Software · doi:10.21105/joss.05320 · Cited by 11
Automated algorithm selection using meta-learning and pre-trained deep convolution neural networks
Dagan, I., Vainshtein, R., Katz, G., & Rokach, L. (2023) · Information Fusion · doi:10.1016/j.inffus.2023.102210 · Cited by 11
TUNA: Tuning Unstable and Noisy Cloud Applications
Freischuetz, J., Kanellis, K., Kroth, B., & Venkataraman, S. (2025) · European Conference on Computer Systems · doi:10.1145/3689031.3717480 · Cited by 11
Untrained and Unmatched: Fast and Accurate Zero-Training Classification for Tabular Engineering Data
Picard, C., & Ahmed, F. (2024) · Journal of Mechanical Design · doi:10.1115/1.4064811 · Cited by 12
Exploring the brittle-to-ductile transition and microstructural responses of γ −TiAl alloy with a crystal plasticity model incorporating dislocation and twinning
Wu, H., Zhang, Y., Lu, D., Gong, X., Lei, L., Zhang, H., Liu, Y., & Wang, Q. (2024) · Materials & Design · doi:10.1016/j.matdes.2024.113360 · Cited by 10
Robust prior-biased acquisition function for human-in-the-loop Bayesian optimization
Hottin, R. G., Kardassevitch, L., Pham, H., Lajoie, G., & Bonizzato, M. (2025) · Knowledge-Based Systems · doi:10.1016/j.knosys.2025.113039 · Cited by 10
The prediction and optimization of biomass compatibility ratios by machine learning for enhancing methane production in anaerobic co-digestion
Ge, Y., Li, Z., Yuan, Z., Wang, Z., Yan, B., Tao, J., Zhou, S., & Chen, G. (2025) · Bioresource Technology · doi:10.1016/j.biortech.2025.133071 · Cited by 10
Transfer Learning based Search Space Design for Hyperparameter Tuning
Li, Y., Shen, Y., Jiang, H., Bai, T., Zhang, W., Zhang, C., & Cui, B. (2022) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3534678.3539369 · Cited by 11
An efficient hyper-parameter optimization method for supervised learning
Shi, Y., Qi, H., Qi, X., & Mu, X. (2022) · Applied Soft Computing · doi:10.1016/j.asoc.2022.109266 · Cited by 10
Multi-Objective Optimization of Performance and Interpretability of Tabular Supervised Machine Learning Models
Schneider, L., Bischl, B., & Thomas, J. (2023) · Genetic and Evolutionary Computation Conference (GECCO) · doi:10.1145/3583131.3590380 · Cited by 14
Boosted multilayer feedforward neural network with multiple output layers
Aly, H., Al-Ali, A. K., & Suganthan, P. N. (2024) · Pattern Recognition · doi:10.1016/j.patcog.2024.110740 · Cited by 9
Hybrid CF-CNN-BiLSTM hypertuned by Bayesian optimization for thermal power generation and decarbonization forecasting
Buratto, W. G., Muniz, R. N., Nied, A., Barros, C. F. D. O., Finardi, E. C., & González, G. V. (2025) · International Journal of Electrical Power & Energy Systems · doi:10.1016/j.ijepes.2025.111199 · Cited by 9
Olympus, enhanced: benchmarking mixed-parameter and multi-objective optimization in chemistry and materials sciencePreprint
Hickman, R. J., Parakh, P., Cheng, A., Ai, Q., Schrier, J., Aldeghi, M., & Aspuru‐Guzik, A. (2023) · ChemRxiv · doi:10.26434/chemrxiv-2023-74w8d · Cited by 15
Generating Cheap Representative Functions for Expensive Automotive Crashworthiness Optimization
Long, F. X., van Stein, B., Frenzel, M. A., Krause, P., Gitterle, M., & Bäck, T. (2024) · ACM Transactions on Evolutionary Learning and Optimization · doi:10.1145/3646554 · Cited by 8
The Value of Hyperparameter Optimization in Phase-Picking Neural Networks
Park, Y., & Shelly, D. R. (2024) · The Seismic Record · doi:10.1785/0320240025 · Cited by 8
Practitioner Motives to Use Different Hyperparameter Optimization Methods
Kannengießer, N., Hasebrook, N., Morsbach, F., Zöller, M.-A., Franke, J. K. H., Lindauer, M., Hutter, F., & Sunyaev, A. (2025) · ACM Transactions on Computer-Human Interaction · doi:10.1145/3745771 · Cited by 8
Self-citation
SBArchOpt: Surrogate-Based Architecture Optimization
Bussemaker, J. (2023) · The Journal of Open Source Software · doi:10.21105/joss.05564 · Cited by 8
A multi-objective optimization framework for reducing the impact of ship noise on marine mammals
Venkateshwaran, A., Deo, I. K., Jelovica, J., & Jaiman, R. K. (2024) · Ocean Engineering · doi:10.1016/j.oceaneng.2024.118687 · Cited by 8
Hybrid training of deep neural networks with multiple output layers for tabular data classification
Hamdy, M., Al-Ali, A. K., Suganthan, P. N., & Aly, H. (2025) · Pattern Recognition · doi:10.1016/j.patcog.2025.112035 · Cited by 8
Artificial intelligence for optimization: Unleashing the potential of parameter generation, model formulation, and solution methods
Fan, Z., Ghaddar, B., Wang, X., Xing, L., Zhang, Y. A., & Zhou, Z. (2025) · European Journal of Operational Research · doi:10.1016/j.ejor.2025.08.029 · Cited by 40
Using Reinforcement Learning for Per-Instance Algorithm Configuration on the TSP
Seiler, M. V., Rook, J., Heins, J., Preuß, O. L., Bossek, J., & Trautmann, H. (2023) · IEEE Symposium Series on Computational Intelligence (SSCI) · doi:10.1109/ssci52147.2023.10372008 · Cited by 7
An efficient evolutionary architecture search for variational autoencoder with alternating optimization and adaptive crossover
Shang, R., Liu, H., Li, W., Zhang, W., Ma, T., & Jiao, L. (2024) · Swarm and Evolutionary Computation · doi:10.1016/j.swevo.2024.101520 · Cited by 7
Letting a Large Neighborhood Search for an Electric Dial-A-Ride Problem Fly: On-The-Fly Charging Station Insertion
Bresich, M., Raidl, G. R., & Limmer, S. (2024) · Genetic and Evolutionary Computation Conference (GECCO) · doi:10.1145/3638529.3654057 · Cited by 7
Metaheuristic algorithms for the bus driver scheduling problem with complex break constraints
Kletzander, L., Mazzoli, T. M., & Musliu, N. (2022) · Genetic and Evolutionary Computation Conference (GECCO) · doi:10.1145/3512290.3528876 · Cited by 7
Automatic MILP solver configuration by learning problem similarities
Hosny, A., & Reda, S. (2023) · Annals of Operations Research · doi:10.1007/s10479-023-05508-x · Cited by 9
FPIA: Field-Programmable Ising Arrays with In-Memory Computing
Hutchinson, G. H., Sifferman, E., Bhattacharya, T., Kwon, D., & Strukov, D. B. (2024) · International Symposium on Low Power Electronics and Design (ISLPED) · doi:10.1145/3665314.3670851 · Cited by 11
Enhancing a Hierarchical Evolutionary Strategy Using the Nearest-Better Clustering
Guzowski, H., Smółka, M., & Pekař, L. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-63759-9_43 · Cited by 6
GEDI: Generating Event Data with Intentional Features for Benchmarking Process Mining
Maldonado, A., Frey, C. M. M., Tavares, G. M., Rehwald, N., & Seidl, T. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-70396-6_13 · Cited by 6
Online model tuning in surrogate-assisted optimization — An effective approach considering the cost–benefit tradeoff
Ahrari, A., & Verstraete, D. (2023) · Swarm and Evolutionary Computation · doi:10.1016/j.swevo.2023.101357 · Cited by 7
Bayesian Optimization Meets Self-Distillation
Lee, H., Song, H., Lee, H., Lee, G., Park, S., & Yoo, D. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00163 · Cited by 6
Interactive Hyperparameter Optimization in Multi-Objective Problems via Preference Learning
Giovanelli, J., Tornede, A., Tornede, T., & Lindauer, M. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i11.29106 · Cited by 6
Self-citation
Transfer Learning of Surrogate Models via Domain Affine Transformation
Pan, S., Vermetten, D., López‐Ibáñez, M., Bäck, T., & Wang, H. (2024) · Genetic and Evolutionary Computation Conference (GECCO) · doi:10.1145/3638529.3654032 · Cited by 6
Introducing LensKit-Auto, an Experimental Automated Recommender System (AutoRecSys) Toolkit
Vente, T., Ekstrand, M. D., & Beel, J. (2023) · ACM Conference on Recommender Systems (RecSys) · doi:10.1145/3604915.3610656 · Cited by 6
Hyperparameter optimization of two-branch neural networks in multi-target prediction
Iliadis, D., Wever, M., Bernard De Baets, C., & Waegeman, W. (2024) · Applied Soft Computing · doi:10.1016/j.asoc.2024.111957 · Cited by 6
BLADE: Benchmark suite for LLM-driven Automated Design and Evolution of iterative optimisation heuristics
van Stein, B., Kononova, A. V., Yin, H., & Bäck, T. (2025) · Genetic and Evolutionary Computation Conference Companion (GECCO Companion) · doi:10.1145/3712255.3734347 · Cited by 5
Generative Design of a Gas Turbine Combustor Using Invertible Neural Networks
Krueger, P. P., Gottschalk, H., Werdelmann, B., & Krebs, W. (2024) · Journal of Engineering for Gas Turbines and Power · doi:10.1115/1.4066294 · Cited by 6

Authors: Lindauer, M., Eggensperger, K., Feurer, M., Biedenkapp, A., Deng, D., Benjamins, C., Ruhopf, T., Sass, R., & Hutter, F.
Affiliations: Leibniz University Hannover (DE)
University of Freiburg (DE)
ORCID: Lindauer, Marius
Eggensperger, Katharina
Feurer, Matthias
Biedenkapp, André
Benjamins, Carolin
Hutter, Frank
Venue: arXiv
Publisher: arXiv
Published: 2021
ISSN: 2331-8422 (ISSN-L)
DOI: 10.48550/arxiv.2109.09831
arXiv: 2109.09831
OpenAlex: W3199199693
Cited by: 195
References: 38
Citations by year: 2026: 1 · 2025: 46 · 2024: 60 · 2023: 64 · 2022: 22 · 2021: 2
Type: posted content
Language: en
Open access: green
arxiv.org
Licence: arxiv.org/licenses/nonexclusive-distrib/1.0/
Locations: arXiv (Cornell University) (submittedVersion)
arXiv (Cornell University)
Funders: European Commission
Deutsche Forschungsgemeinschaft (INST 37/935-1, 37/935-1, INST~37/935-1 FUGG, 37/935-1 FUGG)
Eberhard Karls Universität Tübingen
Generalitat de Catalunya (10.13039/501100011033, 13039/501100011033, 501100011033, AEI/10.13039/501100011033, MCIN /AEI/10.13039/501100011033, PID2019)
Agència de Gestió d'Ajuts Universitaris i de Recerca (AEI/10.13039/501100011033, MCIN/AEI/10.13039/501100011033/, 10.13039/501100011033, 13039/501100011033)
Agencia Estatal de Investigación (AEI//10.13039/501100011033/, 501100011033, 10.13039/501100011033, MCIN/AEI/10.13039/501 100 011 033, 13039, .13039/501100011033, MCIN / AEI/10, 10.13039, PID2019-109137GB-C21, AEI/10, PID2019)
Topics: Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning and Data Classification
Social Sciences › Decision Sciences › Management Science and Operations Research › Advanced Bandit Algorithms Research
Physical Sciences › Computer Science › Artificial Intelligence › Metaheuristic Optimization Algorithms Research
Keywords: Bayesian optimization, hyperparameter optimization, automated machine learning, global optimization, multi-fidelity optimization, algorithm configuration, hyperparameter search

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

SMAC3: A Versatile Bayesian Optimization Package for Hyperparameter Optimization

Abstract

Overview

Integrity signals

Verification

Claims the paper makes

Claims other papers make about this one

Self-check

Citations

Cites

Cited by

Related

Metadata

Record

About these checks