The DOI matches its Crossref record; 47 of the 47 references it cites were found in a registry or an index.
A Stochastic Radial Basis Function Method for the Global Optimization of Expensive Functions
Abstract
We introduce a new framework for the global optimization of computationally expensive multimodal functions when derivatives are unavailable. The proposed Stochastic Response Surface (SRS) Method iteratively utilizes a response surface model to approximate the expensive function and identifies a promising point for function evaluation from a set of randomly generated points, called candidate points. Assuming some mild technical conditions, SRS converges to the global minimum in a probabilistic sense. We also propose Metric SRS (MSRS), which is a special case of SRS where the function evaluation point in each iteration is chosen to be the best candidate point according to two criteria: the estimated function value obtained from the response surface model, and the minimum distance from previously evaluated points. We develop a global optimization version and a multistart local optimization version of MSRS. In the numerical experiments, we used a radial basis function (RBF) model for MSRS and the resulting algorithms, Global MSRBF and Multistart Local MSRBF, were compared to 6 alternative global optimization methods, including a multistart derivative-based local optimization method. Multiple trials of all algorithms were compared on 17 multimodal test problems and on a 12-dimensional groundwater bioremediation application involving partial differential equations. The results indicate that Multistart Local MSRBF is the best on most of the higher dimensional problems, including the groundwater problem. It is also at least as good as the other algorithms on most of the lower dimensional problems. Global MSRBF is competitive with the other alternatives on most of the lower dimensional test problems and also on the groundwater problem. These results suggest that MSRBF is a promising approach for the global optimization of expensive functions.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A Simplex Method for Function Minimization
Nelder, J. A., & Mead, R. (1965) · The Computer Journal · doi:10.1093/comjnl/7.4.308 · Cited by 28,905
No free lunch theorems for optimization
Wolpert, D. H., & Macready, W. G. (1997) · IEEE Transactions on Evolutionary Computation · doi:10.1109/4235.585893 · Cited by 14,237
(2021) · A First Course in Statistical Programming with R · doi:10.1017/9781108993456.011 · Cited by 13,724
Response Surface Methodology: Process and Product Optimization Using Designed Experiments
Gunst, R. F., Myers, R. H., & Montgomery, D. C. (1996) · Technometrics · doi:10.2307/1270613 · Cited by 9,530
(1999) · Springer Series in Operations Research and Financial Engineering · doi:10.1007/b98874 · Cited by 9,482
Cressie, N. (1992) · Terra Nova · doi:10.1111/j.1365-3121.1992.tb00605.x · Cited by 8,823
Efficient Global Optimization of Expensive Black-Box Functions
Jones, D. R., Schonlau, M., & Welch, W. J. (1998) · Journal of Global Optimization · doi:10.1023/a:1008306431147 · Cited by 8,070
Multivariate Adaptive Regression Splines
Friedman, J. H. (1991) · The Annals of Statistics · doi:10.1214/aos/1176347963 · Cited by 8,000
Design and Analysis of Computer Experiments
Sacks, J., Welch, W. J., Mitchell, T. J., & Wynn, H. P. (1989) · Statistical Science · doi:10.1214/ss/1177012413 · Cited by 6,919
Cressie, N. A. C. (1993) · Wiley Series in Probability and Statistics · doi:10.1002/9781119115151 · Cited by 6,507
Empirical Model Building and Response Surfaces
Freeny, A. (1988) · Technometrics · doi:10.1080/00401706.1988.10488371 · Cited by 5,235
Rees, M., & Cressie, N. (1993) · Journal of the Royal Statistical Society. Series A (Statistics in Society) · doi:10.2307/2982871 · Cited by 5,101
Response Surface Methodology: Process and Product Optimization Using Designed Experiments
Gunst, R. F. (1996) · Technometrics · doi:10.1080/00401706.1996.10484509 · Cited by 3,255
A Taxonomy of Global Optimization Methods Based on Response Surfaces
Jones, D. R. (2001) · Journal of Global Optimization · doi:10.1023/a:1012771025575 · Cited by 2,159
Iterative Methods for Optimization
Kelley, C. T. (1999) · Society for Industrial and Applied Mathematics eBooks · doi:10.1137/1.9781611970920 · Cited by 2,052
Introduction to Stochastic Search and Optimization: Estimation, Simulation, and Control
Spall, J. C. (2003) · Wiley eBooks · doi:10.1002/0471722138 · Cited by 1,890
Buhmann, M. (2015) · Encyclopedia of Applied and Computational Mathematics · doi:10.1007/978-3-540-70529-1_306 · Cited by 1,793
Törn, A., & Žilinskas, A. (1989) · Cited by 1,673
Buhmann, M. D. (2000) · Acta Numerica · doi:10.1017/s0962492900000015 · Cited by 1,654
On the Convergence of Pattern Search Algorithms
Torczon, V. (1997) · SIAM Journal on Optimization · doi:10.1137/s1052623493250780 · Cited by 1,336
Introduction to Global Optimization
Horst, R., Pardalos, P. M., & Thoai, N. V. (2000) · Nonconvex Optimization and Its Applications · doi:10.1007/978-1-4615-0015-5 · Cited by 1,217
Exploratory designs for computational experiments
Morris, M. D., & Mitchell, T. J. (1995) · Journal of Statistical Planning and Inference · doi:10.1016/0378-3758(94)00035-t · Cited by 1,197
A rigorous framework for optimization of expensive functions by surrogates
Booker, A. J., Dennis, J. E., Frank, P. D., Serafini, D. B., Torczon, V., & Trosset, M. W. (1999) · Structural Optimization · doi:10.1007/bf01197708 · Cited by 960
A Radial Basis Function Method for Global Optimization
Gutmann, H.-M. (2001) · Journal of Global Optimization · doi:10.1023/a:1011255519438 · Cited by 910
A template for scatter search and path relinking
Glover, F. (1998) · Lecture notes in computer science · doi:10.1007/bfb0026589 · Cited by 727
Scatter Search and Local NLP Solvers: A Multistart Framework for Global Optimization
Ugray, Z., Lasdon, L., Plummer, J., Glover, F., Kelly, J., & Martí, R. (2007) · INFORMS Journal on Computing · doi:10.1287/ijoc.1060.0175 · Cited by 726
Empirical Model-Building and Response Surfaces.
Pike, D. J., Box, G. E. P., & Draper, N. R. (1988) · Journal of the Royal Statistical Society. Series A (Statistics in Society) · doi:10.2307/2982196 · Cited by 716
Zimmermann, H. (1979) · European Journal of Operational Research · doi:10.1016/0377-2217(79)90240-6 · Cited by 698
The Theory of Radial Basis Function Approximation in 1990
Powell, M. J. D. (1992) · Advances in Numerical Analysis · doi:10.1093/oso/9780198534396.003.0003 · Cited by 576
Comparison of response surface and kriging models for multidisciplinary design optimization
Simpson, T., Mistree, F., Korte, J., & Mauery, T. (1998) · 7th AIAA/USAF/NASA/ISSMO Symposium on Multidisciplinary Analysis and Optimization · doi:10.2514/6.1998-4755 · Cited by 494
Algorithmic construction of optimal symmetric Latin hypercube designs
Ye, K. Q., Li, W. H. C., & Sudjianto, A. (2000) · Journal of Statistical Planning and Inference · doi:10.1016/s0378-3758(00)00105-1 · Cited by 438
Generalized descent for global optimization
Griewank, A. (1981) · Journal of Optimization Theory and Applications · doi:10.1007/bf00933356 · Cited by 381
Stochastic global optimization methods part II: Multi level methods
Rinnooy Kan, A. H. G., & Timmer, G. T. (1987) · Mathematical Programming · doi:10.1007/bf02592071 · Cited by 379
UOBYQA: unconstrained optimization by quadratic approximation
Powell, M. J. D. (2002) · Mathematical Programming · doi:10.1007/s101070100290 · Cited by 352
Koehler, J. R., & Owen, A. B. (1996) · Handbook of Statistics · doi:10.1016/s0169-7161(96)13011-x · Cited by 322
Scatter Search: Methodology and Implementations in C
(2003) · Operations Research/Computer Science Interfaces Series · doi:10.1007/978-1-4615-0337-8 · Cited by 316
Direct Search Methods on Parallel Machines
Dennis, J. E., & Torczon, V. (1992) · Operations Research ’91 · doi:10.1007/978-3-642-48417-9_2 · Cited by 279
Recent progress in unconstrained nonlinear optimization without derivatives
Conn, A. R., Scheinberg, K., & Toint, P. L. (1997) · Mathematical Programming · doi:10.1007/bf02614326 · Cited by 255
Direct Search Methods on Parallel Machines
Dennis, Jr., & Torczon, V. (1991) · SIAM Journal on Optimization · doi:10.1137/0801027 · Cited by 251
An Implicit Filtering Algorithm for Optimization of Functions with Many Local Minima
Gilmore, P., & Kelley, C. T. (1995) · SIAM Journal on Optimization · doi:10.1137/0805015 · Cited by 171
Global Optimization of Costly Nonconvex Functions Using Radial Basis Functions
Björkman, M., & Holmström, K. (2000) · Optimization and Engineering · doi:10.1023/a:1011584207202 · Cited by 159
Introduction to Global Optimization.
Tofallis, C., Horst, R., Padalos, P. M., & Thoai, N. V. (1996) · Journal of the Operational Research Society · doi:10.2307/3010143 · Cited by 157
Berghen, F. V., & Bersini, H. (2005) · Journal of Computational and Applied Mathematics · doi:10.1016/j.cam.2004.11.029 · Cited by 135
On trust region methods for unconstrained minimization without derivatives
Powell, M. J. D. (2003) · Mathematical Programming · doi:10.1007/s10107-003-0430-6 · Cited by 134
Optimization Software Class Libraries
VoÃ, S., & Woodruff, D. L. (2002) · Operations research, computer science. Interface series · doi:10.1007/b101931 · Cited by 115
Recent research at Cambridge on radial basis functions
Powell, M. J. D. (1999) · Birkhäuser Basel eBooks · doi:10.1007/978-3-0348-8696-3_14 · Cited by 79
Laguna, M., & Martı́, R. (2005) · Kluwer Academic Publishers eBooks · doi:10.1007/0-306-48126-x_7 · Cited by 53
Cited by
Sun, L., Gao, H., Pan, S., & Wang, J.-X. (2020) · Computer Methods in Applied Mechanics and Engineering · doi:10.1016/j.cma.2019.112732 · Cited by 1,045
Review of surrogate modeling in water resources
Razavi, S., Tolson, B. A., & Burn, D. H. (2012) · Water Resources Research · doi:10.1029/2011wr011527 · Cited by 983
Shan, S., & Wang, G. G. (2010) · Structural and Multidisciplinary Optimization · doi:10.1007/s00158-009-0420-2 · Cited by 597
A review of surrogate models and their application to groundwater modeling
Asher, M. J., Croke, B. F. W., Jakeman, A. J., & Peeters, L. J. M. (2015) · Water Resources Research · doi:10.1002/2015wr016967 · Cited by 594
Benchmarking Derivative-Free Optimization Algorithms
Moré, J. J., & Wild, S. M. (2009) · SIAM Journal on Optimization · doi:10.1137/080724083 · Cited by 573
Metadata
- Authors
- Regis, R. G., & Shoemaker, C. A.
- Venue
- INFORMS Journal on Computing
- Published
- 2007-11
- Volume
- 19
- Issue
- 4
- Pages
- 497-509
- ISSN
- 0899-1499 (ISSN-L)
- 1091-9856
- 1526-5528
- OpenAlex
- W1988945200
- Cited by
- 528
- References
- 47
- FWCI
- 6.25
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.