The DOI matches its Crossref record.
Practical Methods of Optimization
Abstract
Fully describes optimization methods that are currently most valuable in solving real-life problems. Since optimization has applications in almost every branch of science and technology, the text emphasizes their practical aspects in conjunction with the heuristics useful in making them perform more reliably and efficiently. To this end, it presents comparative numerical studies to give readers a feel for possibile applications and to illustrate the problems in assessing evidence. Also provides theoretical background which provides insights into how methods are derived. This edition offers rev
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cited by
QUANTUM ESPRESSO: a modular and open-source software project for quantum simulations of materials
Giannozzi, P., Baroni, S., Bonini, N., Calandra, M., Car, R., Cavazzoni, C., Ceresoli, D., Chiarotti, G. L., Cococcioni, M., Dabo, I., et al. (2009) · Journal of Physics: Condensed Matter · doi:10.1088/0953-8984/21/39/395502 · Cited by 29,281
ModelFinder: fast model selection for accurate phylogenetic estimates
Kalyaanamoorthy, S., Minh, B. Q., Wong, T. K. F., von Haeseler, A., & Jermiin, L. S. (2017) · Nature Methods · doi:10.1038/nmeth.4285 · Cited by 18,449
A Tutorial on Support Vector Machines for Pattern Recognition
Burges, C. J. C. (1998) · Data Mining and Knowledge Discovery · doi:10.1023/a:1009715923555 · Cited by 16,429
A tutorial on support vector regression
Smola, A. J., & Schölkopf, B. (2004) · Statistics and Computing · doi:10.1023/b:stco.0000035301.49549.88 · Cited by 13,387
Wächter, A., & Biegler, L. T. (2006) · Mathematical Programming · doi:10.1007/s10107-004-0559-y · Cited by 9,483
Least Squares Support Vector Machine Classifiers
Suykens, J. A. K., & Vandewalle, J. (1999) · Neural Processing Letters · doi:10.1023/a:1018628609742 · Cited by 9,362
On the limited memory BFGS method for large scale optimization
Liu, D. C., & Nocedal, J. (1989) · Mathematical Programming · doi:10.1007/bf01589116 · Cited by 8,560
An improved algorithm for reaction path following
Gonzalez, C., & Schlegel, H. B. (1989) · The Journal of Chemical Physics · doi:10.1063/1.456010 · Cited by 6,159
A variational eigenvalue solver on a photonic quantum processor
Peruzzo, A., McClean, J., Shadbolt, P., Yung, M.-H., Zhou, X.-Q., Love, P. J., Aspuru-Guzik, A., & O’Brien, J. L. (2014) · Nature Communications · doi:10.1038/ncomms5213 · Cited by 4,552
“[12] S.”
BackgroundMethodA scaled conjugate gradient algorithm for fast supervised learning
Møller, M. F. (1993) · Neural Networks · doi:10.1016/s0893-6080(05)80056-5 · Cited by 4,052
Bundle Adjustment — A Modern Synthesis
Triggs, B., McLauchlan, P. F., Hartley, R. I., & Fitzgibbon, A. W. (2000) · Lecture Notes in Computer Science · doi:10.1007/3-540-44480-7_21 · Cited by 3,988
An approach to computing electrostatic charges for molecules
Singh, U. C., & Kollman, P. A. (1984) · Journal of Computational Chemistry · doi:10.1002/jcc.540050204 · Cited by 3,428
The explicit linear quadratic regulator for constrained systems
Bemporad, A., Morari, M., Dua, V., & Pistikopoulos, E. N. (2002) · Automatica · doi:10.1016/s0005-1098(01)00174-1 · Cited by 3,260
A second order multiconfiguration SCF procedure with optimum convergence
Werner, H.-J., & Knowles, P. J. (1985) · The Journal of Chemical Physics · doi:10.1063/1.448627 · Cited by 3,182
Survey of Numerical Methods for Trajectory Optimization
Betts, J. T. (1998) · Journal of Guidance, Control, and Dynamics · doi:10.2514/2.4231 · Cited by 2,602
A comprehensive survey on support vector machine classification: Applications, challenges and trends
Cervantes, J., Garcia-Lamont, F., Rodríguez-Mazahua, L., & Lopez, A. (2020) · Neurocomputing · doi:10.1016/j.neucom.2019.10.118 · Cited by 2,381
Numerical solution of saddle point problems
Benzi, M., Golub, G. H., & Liesen, J. (2005) · Acta Numerica · doi:10.1017/s0962492904000212 · Cited by 2,300
Threat of Adversarial Attacks on Deep Learning in Computer Vision: A Survey
Akhtar, N., & Mian, A. (2018) · IEEE Access · doi:10.1109/access.2018.2807385 · Cited by 2,021
Ecopath with Ecosim: Methods, capabilities and limitations
Christensen, V., & Walters, C. J. (2004) · Ecological Modelling · doi:10.1016/j.ecolmodel.2003.09.003 · Cited by 1,914
Extreme learning machines: a survey
Huang, G.-B., Wang, D. H., & Lan, Y. (2011) · International Journal of Machine Learning and Cybernetics · doi:10.1007/s13042-011-0019-y · Cited by 1,914
Maximum likelihood estimation via the ECM algorithm: A general framework
MENG, X.-L., & RUBIN, D. B. (1993) · Biometrika · doi:10.1093/biomet/80.2.267 · Cited by 1,861
Sequential quadratic programming
Boggs, P. T., & Tolle, J. W. (1995) · Acta Numerica · doi:10.1017/s0962492900002518 · Cited by 1,858
Optimization Algorithms on Matrix Manifolds
Absil, P.-A., Mahony, R., & Sepulchre, R. (2008) · Princeton University Press eBooks · doi:10.1515/9781400830244 · Cited by 1,840
A Survey of the Usages of Deep Learning for Natural Language Processing
Otter, D. W., Medina, J. R., & Kalita, J. K. (2021) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2020.2979670 · Cited by 1,836
Particle swarm optimization (PSO). A tutorial
Marini, F., & Walczak, B. (2015) · Chemometrics and Intelligent Laboratory Systems · doi:10.1016/j.chemolab.2015.08.020 · Cited by 1,828
An Interior Point Algorithm for Large-Scale Nonlinear Programming
Byrd, R. H., Hribar, M. E., & Nocedal, J. (1999) · SIAM Journal on Optimization · doi:10.1137/s1052623497325107 · Cited by 1,739
Noisy intermediate-scale quantum algorithms
Bharti, K., Cervera-Lierta, A., Kyaw, T. H., Haug, T., Alperin-Lea, S., Anand, A., Degroote, M., Heimonen, H., Kottmann, J. S., Menke, T., et al. (2022) · Reviews of Modern Physics · doi:10.1103/revmodphys.94.015004 · Cited by 2,231
SNOPT: An SQP Algorithm for Large-Scale Constrained Optimization
Gill, P. E., Murray, W., & Saunders, M. A. (2002) · SIAM Journal on Optimization · doi:10.1137/s1052623499350013 · Cited by 1,587
Moré, J. J., & Sorensen, D. C. (1983) · SIAM Journal on Scientific and Statistical Computing · doi:10.1137/0904038 · Cited by 1,411
Recent approaches to global optimization problems through Particle Swarm Optimization
Parsopoulos, K. E., & Vrahatis, M. N. (2002) · Natural Computing · doi:10.1023/a:1016568309421 · Cited by 1,406
Stillinger, F. H., & Weber, T. A. (1982) · Physical Review A · doi:10.1103/physreva.25.978 · Cited by 1,375
Svanberg, K. (2002) · SIAM Journal on Optimization · doi:10.1137/s1052623499362822 · Cited by 1,371
Ben‐Hur, A., Horn, D., Siegelmann, H. T., & Vapnik, V. N. (2002) · doi:10.5555/944790.944807 · Cited by 1,330
Versluis, L., & Ziegler, T. (1988) · The Journal of Chemical Physics · doi:10.1063/1.454603 · Cited by 1,327
Weighted least squares support vector machines: robustness and sparse approximation
Suykens, J. A. K., De Brabanter, J., Lukas, L., & Vandewalle, J. (2002) · Neurocomputing · doi:10.1016/s0925-2312(01)00644-0 · Cited by 1,265
qpOASES: a parametric active-set algorithm for quadratic programming
Ferreau, H. J., Kirches, C., Potschka, A., Bock, H. G., & Diehl, M. (2014) · Mathematical Programming Computation · doi:10.1007/s12532-014-0071-1 · Cited by 1,265
Are Forecasting Models Usable for Policy Analysis?
Sims, C. (1986) · Quarterly Review · doi:10.21034/qr.1011 · Cited by 1,197
A Nonmonotone Line Search Technique for Newton’s Method
Grippo, L., Lampariello, F., & Lucidi, S. (1986) · SIAM Journal on Numerical Analysis · doi:10.1137/0723046 · Cited by 1,156
Forecasting stock market movement direction with support vector machine
Huang, W., Nakamori, Y., & Wang, S.-Y. (2005) · Computers & Operations Research · doi:10.1016/j.cor.2004.03.016 · Cited by 1,119
PhysNet: A Neural Network for Predicting Energies, Forces, Dipole Moments, and Partial Charges
Unke, O. T., & Meuwly, M. (2019) · Journal of Chemical Theory and Computation · doi:10.1021/acs.jctc.9b00181 · Cited by 1,073
Space Mapping: The State of the Art
Bandler, J. W., Cheng, Q. S., Dakroury, S. A., Mohamed, A. S., Bakr, M. H., Madsen, K., & Sondergaard, J. (2004) · IEEE Transactions on Microwave Theory and Techniques · doi:10.1109/tmtt.2003.820904 · Cited by 1,064
An interior algorithm for nonlinear optimization that combines line search and trust region steps
Waltz, R. A., Morales, J. L., Nocedal, J., & Orban, D. (2006) · Mathematical Programming · doi:10.1007/s10107-004-0560-5 · Cited by 1,057
Hand, D. J. (2007) · Drug Safety · doi:10.2165/00002018-200730070-00010 · Cited by 1,044
Diabolical conical intersections
Yarkony, D. R. (1996) · Reviews of Modern Physics · doi:10.1103/revmodphys.68.985 · Cited by 1,041
Hratchian, H. P., & Schlegel, H. B. (2005) · Journal of Chemical Theory and Computation · doi:10.1021/ct0499783 · Cited by 985
Efficient anisotropic refinement of macromolecular structures using FFT
Murshudov, G. N., Vagin, A. A., Lebedev, A., Wilson, K. S., & Dodson, E. J. (1999) · Acta Crystallographica Section D Biological Crystallography · doi:10.1107/s090744499801405x · Cited by 936
Kalman filtering with state constraints: a survey of linear and nonlinear algorithms
Simon, D. (2010) · IET Control Theory & Applications · doi:10.1049/iet-cta.2009.0032 · Cited by 890
Genetic algorithm optimization applied to electromagnetics: a review
Weile, D. S., & Michielssen, E. (1997) · IEEE Transactions on Antennas and Propagation · doi:10.1109/8.558650 · Cited by 881
Optimization method based extreme learning machine for classification
Huang, G.-B., Ding, X., & Zhou, H. (2010) · Neurocomputing · doi:10.1016/j.neucom.2010.02.019 · Cited by 869
IMU-Based Joint Angle Measurement for Gait Analysis
Seel, T., Raisch, J., & Schauer, T. (2014) · Sensors · doi:10.3390/s140406891 · Cited by 867
A note on Platt’s probabilistic outputs for support vector machines
Lin, H.-T., Lin, C.-J., & Weng, R. C. (2007) · Machine Learning · doi:10.1007/s10994-007-5018-6 · Cited by 867
A feasible method for optimization with orthogonality constraints
Wen, Z., & Yin, W. (2013) · Mathematical Programming · doi:10.1007/s10107-012-0584-1 · Cited by 849
Monotone Regression Splines in Action
Ramsay, J. O. (1988) · Statistical Science · doi:10.1214/ss/1177012761 · Cited by 848
Robust Control in Power Systems
(2005) · Power Electronics and Power Systems · doi:10.1007/b136490 · Cited by 838
Reinforcement learning of motor skills with policy gradients
Peters, J., & Schaal, S. (2008) · Neural Networks · doi:10.1016/j.neunet.2008.02.003 · Cited by 831
Linear transmit processing in MIMO communications systems
Joham, M., Utschick, W., & Nossek, J. A. (2005) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2005.850331 · Cited by 811
Recent progress on reservoir history matching: a review
Oliver, D. S., & Chen, Y. (2011) · Computational Geosciences · doi:10.1007/s10596-010-9194-2 · Cited by 804
Cubic regularization of Newton method and its global performance
Nesterov, Y., & Polyak, B. T. (2006) · Mathematical Programming · doi:10.1007/s10107-006-0706-8 · Cited by 781
A nonlinear programming algorithm for solving semidefinite programs via low-rank factorization
Burer, S., & Monteiro, R. D. C. (2003) · Mathematical Programming · doi:10.1007/s10107-002-0352-8 · Cited by 770
Inuiguchi, M., & Ramı́k, J. (2000) · Fuzzy Sets and Systems · doi:10.1016/s0165-0114(98)00449-7 · Cited by 769
Representations of quasi-Newton matrices and their use in limited memory methods
Byrd, R. H., Nocedal, J., & Schnabel, R. B. (1994) · Mathematical Programming · doi:10.1007/bf01582063 · Cited by 744
The Hysteresis Bouc-Wen Model, a Survey
Ismail, M., Ikhouane, F., & Rodellar, J. (2009) · Archives of Computational Methods in Engineering · doi:10.1007/s11831-009-9031-8 · Cited by 740
The path solver: a nommonotone stabilization scheme for mixed complementarity problems
Dirkse, S. P., & Ferris, M. C. (1995) · Optimization Methods and Software · doi:10.1080/10556789508805606 · Cited by 734
A coordinate gradient descent method for nonsmooth separable minimization
Tseng, P., & Yun, S. (2009) · Mathematical Programming · doi:10.1007/s10107-007-0170-0 · Cited by 728
Quantitative spectroscopic photoacoustic imaging: a review
Cox, B., Laufer, J. G., Arridge, S. R., & Beard, P. C. (2012) · Journal of Biomedical Optics · doi:10.1117/1.jbo.17.6.061202 · Cited by 720
Mixed-integer nonlinear optimization
Belotti, P., Kirches, C., Leyffer, S., Linderoth, J., Luedtke, J., & Mahajan, A. (2013) · Acta Numerica · doi:10.1017/s0962492913000032 · Cited by 712
Interior Methods for Nonlinear Optimization
Forsgren, A., Gill, P. E., & Wright, M. H. (2002) · SIAM Review · doi:10.1137/s0036144502414942 · Cited by 699
Conical intersections and double excitations in time-dependent density functional theory
Levine, B. G., Ko, C., Quenneville, J., & MartÍnez, T. J. (2006) · Molecular Physics · doi:10.1080/00268970500417762 · Cited by 695
Rate-distortion optimized streaming of packetized media
Chou, P. A., & Miao, Z. (2006) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2005.864313 · Cited by 667
Berg, J., & Nyström, K. (2018) · Neurocomputing · doi:10.1016/j.neucom.2018.06.056 · Cited by 657
Latch, E. K., Dharmarajan, G., Glaubitz, J. C., & Rhodes, O. E. (2006) · Conservation Genetics · doi:10.1007/s10592-005-9098-1 · Cited by 653
On the Learnability and Design of Output Codes for Multiclass Problems
Crammer, K., & Singer, Y. (2002) · Machine Learning · doi:10.1023/a:1013637720281 · Cited by 650
Simulation Modeling and Analysis
Gupta, A. (2016) · Decision Sciences · doi:10.1201/9781315183176-14 · Cited by 640
A REVIEW OF LEAST‐SQUARES INVERSION AND ITS APPLICATION TO GEOPHYSICAL PROBLEMS*
LINES, L. R., & TREITEL, S. (1984) · Geophysical Prospecting · doi:10.1111/j.1365-2478.1984.tb00726.x · Cited by 635
Rigid-Body Dynamics with Friction and Impact
Stewart, D. E. (2000) · SIAM Review · doi:10.1137/s0036144599360110 · Cited by 628
Data-Enabled Predictive Control: In the Shallows of the DeePC
Coulson, J., Lygeros, J., & Dorfler, F. (2019) · 2019 18th European Control Conference (ECC) · doi:10.23919/ecc.2019.8795639 · Cited by 628
Neural Networks and Related Methods for Classification
Ripley, B. D. (1994) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1994.tb01990.x · Cited by 627
Numerical optimization: theoretical and practical aspects
(2003) · Choice Reviews Online · doi:10.5860/choice.41-0357 · Cited by 614
A survey of inverse reinforcement learning: Challenges, methods and progress
Arora, S., & Doshi, P. (2021) · Artificial Intelligence · doi:10.1016/j.artint.2021.103500 · Cited by 610
Vreven, T., Morokuma, K., Farkas, Ö., Schlegel, H. B., & Frisch, M. J. (2003) · Journal of Computational Chemistry · doi:10.1002/jcc.10156 · Cited by 608
Coelho, L. S., & Mariani, V. C. (2006) · IEEE Transactions on Power Systems · doi:10.1109/tpwrs.2006.873410 · Cited by 597
Biegler, L. T., & Grossmann, I. E. (2004) · Computers & Chemical Engineering · doi:10.1016/j.compchemeng.2003.11.003 · Cited by 593
Jain, A. N. (2007) · Journal of Computer-Aided Molecular Design · doi:10.1007/s10822-007-9114-2 · Cited by 587
Katritzky, A. R., Kuanar, M., Slavov, S., Hall, C. D., Karelson, M., Kahn, I., & Dobchev, D. A. (2010) · Chemical Reviews · doi:10.1021/cr900238d · Cited by 575
On Sparse Representations in Arbitrary Redundant Bases
Fuchs, J.-J. (2004) · IEEE Transactions on Information Theory · doi:10.1109/tit.2004.828141 · Cited by 563
Graph Regularized Sparse Coding for Image Representation
Zheng, M., Bu, J., Chen, C., Wang, C., Zhang, L., Qiu, G., & Cai, D. (2011) · IEEE Transactions on Image Processing · doi:10.1109/tip.2010.2090535 · Cited by 562
Newton’s Method with a Model Trust Region Modification
Sorensen, D. C. (1982) · SIAM Journal on Numerical Analysis · doi:10.1137/0719026 · Cited by 560
Yang, D., Kleissl, J., Gueymard, C. A., Pedro, H. T. C., & Coimbra, C. F. M. (2018) · Solar Energy · doi:10.1016/j.solener.2017.11.023 · Cited by 548
Principles of optimal design-modeling and computation
(1989) · Mathematics and Computers in Simulation · doi:10.1016/0378-4754(89)90173-0 · Cited by 544
Optimal control by least squares support vector machines
Suykens, J. A. K., Vandewalle, J., & De Moor, B. (2001) · Neural Networks · doi:10.1016/s0893-6080(00)00077-0 · Cited by 540
Support vector machines for SAR automatic target recognition
Zhao, Q., & Principe, J. C. (2001) · IEEE Transactions on Aerospace and Electronic Systems · doi:10.1109/7.937475 · Cited by 540
van Ginneken, B., Stegmann, M. B., & Loog, M. (2006) · Medical Image Analysis · doi:10.1016/j.media.2005.02.002 · Cited by 539
Efficient Numerical Methods for Nonlinear MPC and Moving Horizon Estimation
Diehl, M., Ferreau, H. J., & Haverbeke, N. (2009) · Lecture Notes in Control and Information Sciences · doi:10.1007/978-3-642-01094-1_32 · Cited by 539
Application of Interior-Point Methods to Model Predictive Control
Rao, C. V., Wright, S. J., & Rawlings, J. B. (1998) · Journal of Optimization Theory and Applications · doi:10.1023/a:1021711402723 · Cited by 536
On coreference resolution performance metrics
Luo, X. (2005) · Proceedings of the conference on Human Language Technology and Empirical Methods in Natural Language Processing - HLT '05 · doi:10.3115/1220575.1220579 · Cited by 536
Neural-network methods for boundary value problems with irregular boundaries
Lagaris, I. E., Likas, A. C., & Papageorgiou, D. G. (2000) · IEEE Transactions on Neural Networks · doi:10.1109/72.870037 · Cited by 521
The GAMESS-UK electronic structure package: algorithms, developments and applications
Guest *, M. F., Bush, I. J., Van Dam, H. J. J., Sherwood, P., Thomas, J. M. H., Van Lenthe, J. H., Havenith, R. W. A., & Kendrick, J. (2005) · Molecular Physics · doi:10.1080/00268970512331340592 · Cited by 514
Policy Gradient Methods for Robotics
Peters, J., & Schaal, S. (2006) · 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems · doi:10.1109/iros.2006.282564 · Cited by 498
Supervisory and Optimal Control of Building HVAC Systems: A Review
Wang, S., & Ma, Z. (2008) · HVAC&R Research · doi:10.1080/10789669.2008.10390991 · Cited by 496
Nonlinear Predictive Control and Moving Horizon Estimation — An Introductory Overview
Allgöwer, F., Badgwell, T. A., Qin, J. S., Rawlings, J. B., & Wright, S. J. (1999) · Advances in Control · doi:10.1007/978-1-4471-0853-5_19 · Cited by 474
Metadata
- Authors
- Fletcher, R.
- Venue
- Wiley eBooks
- Publisher
- Wiley
- Published
- 2000-05-23
- OpenAlex
- W2077658674
- Cited by
- 7,605
- References
- 0
- FWCI
- 28.75
- Type
- book
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.