The DOI matches its OpenAlex record; 32 of the 32 references it cites were found in a registry or an index.
Hyperparameter Search in Machine Learning
Open accessOverview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Breiman, L. (2001) · Machine Learning · doi:10.1023/a:1010933404324 · Cited by 133,538
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Scikit-learn: Machine Learning in Python
Pedregosa, F., Varoquaux, G., Gramfort, A., Michel, V., Thirion, B., Grisel, O., Blondel, M., Müller, A., Nothman, J., Louppe, G., et al. (2012) · arXiv · doi:10.48550/arxiv.1201.0490 · Cited by 71,016
A tutorial on hidden Markov models and selected applications in speech recognition
Rabiner, L. R. (1989) · Proceedings of the IEEE · doi:10.1109/5.18626 · Cited by 22,743 · cited 1×
“hidden Markov models [3] tensor decompositions, e.”
Neural networks for pattern recognition
(1994) · Choice Reviews Online · doi:10.5860/choice.31-5500 · Cited by 18,538
Sequence to Sequence Learning with Neural Networks
Sutskever, I., Vinyals, O., & Le, Q. V. (2014) · arXiv · doi:10.48550/arxiv.1409.3215 · Cited by 17,766
Learning with Kernels: Support Vector Machines, Regularization, Optimization, and Beyond
Schölkopf, B., & Smola, A. J. (2001) · The MIT Press eBooks · doi:10.7551/mitpress/4175.001.0001 · Cited by 11,703
A Study of Cross-Validation and Bootstrap for Accuracy Estimation and Model Selection
Kohavi, R. (1995) · Zenodo · doi:10.5281/zenodo.19712698 · Cited by 10,909
Efficient Global Optimization of Expensive Black-Box Functions
Jones, D. R., Schonlau, M., & Welch, W. J. (1998) · Journal of Global Optimization · doi:10.1023/a:1008306431147 · Cited by 8,070
(2012) · Cited by 8,009
Practical Bayesian Optimization of Machine Learning Algorithms
Snoek, J., Larochelle, H., & Adams, R. P. (2012) · arXiv · doi:10.48550/arxiv.1206.2944 · Cited by 6,691
A Practical Guide to Support Vector Classication
Hsu, C., Chang, C.-C., & Lin, C. (2008) · Cited by 5,046
Large Scale Distributed Deep Networks
Dean, J. B., Corrado, G. S., Monga, R., Chen, K., Devin, M., Mao, M., Ranzato, M., Senior, A., Tucker, P. A., Yang, K., et al. (2012) · neural information processing systems · Cited by 4,489
(2011) · Cited by 3,939
Neural Networks and the Bias/Variance Dilemma
Geman, S., Bienenstock, E., & Doursat, R. (1992) · Neural Computation · doi:10.1162/neco.1992.4.1.1 · Cited by 3,578 · cited 1×
“This is often referred to as the bias-variance trade-off [12, 17], since a complex model exhibits large variance while an overly simple one is strongly biased.”
BackgroundA leisurely look at the bootstrap, the jackknife, and cross-validation
Efron, B., & Gong, G. (1983) · The American Statistician · doi:10.1080/00031305.1983.10483087 · Cited by 3,229
A Practical Guide to Training Restricted Boltzmann Machines
Hinton, G. E. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-35289-8_32 · Cited by 2,852 · cited 1×
“Hyperparameter search is commonly performed manually, via rules-of-thumb [19, 20] or by testing sets of hyperparameters on a predefined grid [28].”
MethodSequential Model-Based Optimization for General Algorithm Configuration
Hutter, F., Hoos, H. H., & Leyton-Brown, K. (2011) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-25566-3_40 · Cited by 2,469
Bergstra, J., Yamins, D. L. K., & Cox, D. (2013) · Digital Access to Scholarship at Harvard (DASH) (Harvard University) · Cited by 1,852
Regularization Networks and Support Vector Machines
Evgeniou, T., Pontil, M., & Poggio, T. (2000) · Advances in Computational Mathematics · doi:10.1023/a:1018946025316 · Cited by 1,197
Lin, S.-W., Ying, K.-C., Chen, S.-C., & Lee, Z.-J. (2008) · Expert Systems with Applications · doi:10.1016/j.eswa.2007.08.088 · Cited by 895
Hyperopt: A Python Library for Optimizing the Hyperparameters of Machine Learning Algorithms
Bergstra, J., Yamins, D., & Cox, D. (2013) · Proceedings of the Python in Science Conference · doi:10.25080/majora-8b375195-003 · Cited by 781
The Entire Regularization Path for the Support Vector Machine
Hastie, T. J., Rosset, S., Tibshirani, R. J., & Zhu, J. (2004) · Journal of Machine Learning Research · Cited by 748
F-Race and Iterated F-Race: An Overview
Birattari, M., Yuan, Z., Balaprakash, P., & Stützle, T. (2010) · Experimental Methods for the Analysis of Optimization Algorithms · doi:10.1007/978-3-642-02538-9_13 · Cited by 413
Support Vector Machine Solvers
Bottou, L., & Lin, C.-J. (2007) · Large-Scale Kernel Machines · doi:10.7551/mitpress/7496.003.0003 · Cited by 336
Xavier-de-Souza, S., Suykens, J. A. K., Vandewalle, J., & Bolle, D. (2010) · IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics) · doi:10.1109/tsmcb.2009.2020435 · Cited by 321
Meissner, M., Schmuker, M., & Schneider, G. (2006) · BMC Bioinformatics · doi:10.1186/1471-2105-7-125 · Cited by 298
Tuning the Structure and Parameters of a Neural Network by Using Hybrid Taguchi-Genetic Algorithm
Tsai, J., Chou, J.-H., & Liu, T.-K. (2006) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2005.860885 · Cited by 296
Best Choices for Regularization Parameters in Learning Theory: On the Bias—Variance Problem
Cucker, F., & Smale, S. (2002) · Foundations of Computational Mathematics · doi:10.1007/s102080010030 · Cited by 261
Bachoc, F. (2013) · Computational Statistics & Data Analysis · doi:10.1016/j.csda.2013.03.016 · Cited by 221
Easy Hyperparameter Search Using OptunityPreprint
Claesen, M., Simm, J., Popovic, D. D., Moreau, Y., & Moor, B. D. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1412.1114 · Cited by 113
Self-citationEnsembleSVM: A Library for Ensemble Learning Using Support Vector MachinesPreprint
Claesen, M., Smet, F. D., Suykens, J. A. K., & Moor, B. D. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1403.0745 · Cited by 81
Self-citation
Cited by
Supervised Contrastive Learning
Khosla, P., Teterwak, P., Wang, C., Sarna, A., Tian, Y., Isola, P., Maschinot, A., Liu, C., & Krishnan, D. (2020) · arXiv · doi:10.48550/arxiv.2004.11362 · Cited by 3,569
“Deep network training is well known to be sensitive to hyper-parameters and a large body of literature is devoted to finding efficient ways to perform hyperparameter tuning [2, 8, 3].”
BackgroundOn hyperparameter optimization of machine learning algorithms: Theory and practice
Yang, L., & Shami, A. (2020) · Neurocomputing · doi:10.1016/j.neucom.2020.07.061 · Cited by 3,232
Machine Learning: New Ideas and Tools in Environmental Science and Engineering
Zhong, S., Zhang, K., Bagheri, M., Burken, J. G., Gu, A., Li, B., Ma, X., Marrone, B. L., Ren, Z. J., Schrier, J., et al. (2021) · Environmental Science & Technology · doi:10.1021/acs.est.1c01339 · Cited by 945
Yang, L., Ao, Y., Ke, J., Lu, Y., & Liang, Y. (2021) · Journal of Transport Geography · doi:10.1016/j.jtrangeo.2021.103099 · Cited by 460
Application of machine learning to construction injury prediction
Tixier, A. J.-P., Hallowell, M. R., Rajagopalan, B., & Bowman, D. (2016) · Automation in Construction · doi:10.1016/j.autcon.2016.05.016 · Cited by 350
Metadata
- Authors
- Claesen, M., & Moor, B. D.
- Venue
- arXiv (Cornell University)
- Publisher
- Cornell University
- Published
- 2015-02-07
- Pages
- 1-5
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1502.02127
- OpenAlex
- W2140404878
- Cited by
- 333
- References
- 32
- Type
- posted content
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.