The DOI matches its Crossref record.
Function minimization by conjugate gradients
Abstract
A quadratically convergent gradient method for locating an unconstrained local minimum of a function of several variables is described. Particular advantages are its simplicity and its modest demands on storage, space for only three vectors being required. An ALGOL procedure is presented, and the paper includes a discussion of results obtained by its used on various test functions.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cited by
CHARMM: A program for macromolecular energy, minimization, and dynamics calculations
Brooks, B. R., Bruccoleri, R. E., Olafson, B. D., States, D. J., Swaminathan, S., & Karplus, M. (1983) · Journal of Computational Chemistry · doi:10.1002/jcc.540040211 · Cited by 14,944
SGDR: Stochastic Gradient Descent with Warm Restarts
Loshchilov, I., & Hutter, F. (2016) · arXiv · doi:10.48550/arxiv.1608.03983 · Cited by 5,309
Optimization of equilibrium geometries and transition structures
Schlegel, H. B. (1982) · Journal of Computational Chemistry · doi:10.1002/jcc.540030212 · Cited by 3,890
Pearlman, D. A., Case, D. A., Caldwell, J. W., Ross, W. S., Cheatham, T. E., DeBolt, S., Ferguson, D., Seibel, G., & Kollman, P. (1995) · Computer Physics Communications · doi:10.1016/0010-4655(95)00041-d · Cited by 3,124
Iterative Methods for Optimization
Kelley, C. T. (1999) · Society for Industrial and Applied Mathematics eBooks · doi:10.1137/1.9781611970920 · Cited by 2,052
Optimization Algorithms on Matrix Manifolds
Absil, P.-A., Mahony, R., & Sepulchre, R. (2008) · Princeton University Press eBooks · doi:10.1515/9781400830244 · Cited by 1,840
Restart procedures for the conjugate gradient method
Powell, M. J. D. (1977) · Mathematical Programming · doi:10.1007/bf01593790 · Cited by 1,717
Introduction to multi-layer feed-forward neural networks
Svozil, D., Kvasnicka, V., & Pospichal, J. (1997) · Chemometrics and Intelligent Laboratory Systems · doi:10.1016/s0169-7439(97)00061-0 · Cited by 1,600
Deformable medical image registration: a survey
Sotiras, A., Davatzikos, C., & Paragios, N. (2013) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2013.2265603 · Cited by 1,587
“Among the well-known formulas for β t , one may cite the Fletcher-Reeves [404], the Polak-Ribi`ere [405], the Polak-Ribi`ere-Polyak [406] and the Hestenes-Stiefel [407].”
MethodCorana, A., Marchesi, M., Martini, C., & Ridella, S. (1987) · ACM Transactions on Mathematical Software · doi:10.1145/29380.29864 · Cited by 1,531
Artificial Neural Networks in Hydrology. I: Preliminary Concepts
ASCE Task Committee on Application of Artificial Neural Networks in Hydrology (2000) · Journal of Hydrologic Engineering · doi:10.1061/(asce)1084-0699(2000)5:2(115 · Cited by 1,476
Nonlinear conjugate gradients algorithm for 2-D magnetotelluric inversion
Rodi, W., & Mackie, R. L. (2001) · Geophysics · doi:10.1190/1.1444893 · Cited by 1,384
The conjugate gradient method in extremal problems
Polyak, B. T. (1969) · USSR Computational Mathematics and Mathematical Physics · doi:10.1016/0041-5553(69)90035-4 · Cited by 1,164
Learning and generalization characteristics of the random vector functional-link net
Pao, Y.-H., Park, G.-H., & Sobajic, D. J. (1994) · Neurocomputing · doi:10.1016/0925-2312(94)90053-1 · Cited by 1,138
Convergence Conditions for Ascent Methods
Wolfe, P. (1969) · SIAM Review · doi:10.1137/1011036 · Cited by 1,106
Note sur la convergence de méthodes de directions conjuguées
Polak, E., & Ribiere, G. (1969) · Revue française d'informatique et de recherche opérationnelle. Série rouge · doi:10.1051/m2an/196903r100351 · Cited by 986
Stochastic choice of basis functions in adaptive function approximation and the functional-link net
Igelnik, B., & Pao, Y.-H. (1995) · IEEE Transactions on Neural Networks · doi:10.1109/72.471375 · Cited by 955
Variational density-functional perturbation theory for dielectrics and lattice dynamics
Refson, K., Tulip, P. R., & Clark, S. J. (2006) · Physical Review B · doi:10.1103/physrevb.73.155114 · Cited by 926
Elements of Artificial Neural Networks
Mehrotra, K., Mohan, C., & Ranka, S. (1996) · The MIT Press eBooks · doi:10.7551/mitpress/2687.001.0001 · Cited by 912
Four Generations of High-Dimensional Neural Network Potentials
Behler, J. (2021) · Chemical Reviews · doi:10.1021/acs.chemrev.0c00868 · Cited by 873
Geotechnical stability analysis
SLOAN, S. W. (2013) · Géotechnique · doi:10.1680/geot.12.rl.001 · Cited by 726
Folding and association of proteins
Jaenicke, R. (1987) · Progress in Biophysics and Molecular Biology · doi:10.1016/0079-6107(87)90011-3 · Cited by 691
Green, P. J. (1984) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1984.tb01288.x · Cited by 687
Problem formulations and solvers in linear SVM: a review
Chauhan, V. K., Dahiya, K., & Sharma, A. (2019) · Artificial Intelligence Review · doi:10.1007/s10462-018-9614-6 · Cited by 660
Pedone, A., Malavasi, G., Menziani, M. C., Cormack, A. N., & Segre, U. (2006) · The Journal of Physical Chemistry B · doi:10.1021/jp0611018 · Cited by 637
Exponential analysis in physical phenomena
Istratov, A. A., & Vyvenko, O. F. (1999) · Review of Scientific Instruments · doi:10.1063/1.1149581 · Cited by 615
Neural networks: A new method for solving chemical problems or just a passing phase?
Zupan, J., & Gasteiger, J. (1991) · Analytica Chimica Acta · doi:10.1016/s0003-2670(00)80865-x · Cited by 579
Invited Article: A unified evaluation of iterative projection algorithms for phase retrieval
Marchesini, S. (2007) · Review of Scientific Instruments · doi:10.1063/1.2403783 · Cited by 573
Byvatov, E., Fechner, U., Sadowski, J., & Schneider, G. (2003) · Journal of Chemical Information and Computer Sciences · doi:10.1021/ci0341161 · Cited by 565
Skilling, J., & Gull, S. F. (1985) · Maximum-Entropy and Bayesian Methods in Inverse Problems · doi:10.1007/978-94-017-2221-6_5 · Cited by 561
Optimization Concepts and Applications in Engineering
Belegundu, A. D., & Chandrupatla, T. R. (2011) · Cambridge University Press eBooks · doi:10.1017/cbo9780511975905 · Cited by 555
Saad, E. W., Prokhorov, D. V., & Wunsch, D. C. (1998) · IEEE Transactions on Neural Networks · doi:10.1109/72.728395 · Cited by 537
Large-scale linearly constrained optimization
Murtagh, B. A., & Saunders, M. A. (1978) · Mathematical Programming · doi:10.1007/bf01588950 · Cited by 527
Calculation of the vacancy formation energy in aluminium
Gillan, M. J. (1989) · Journal of Physics: Condensed Matter · doi:10.1088/0953-8984/1/4/005 · Cited by 512
Hardware implementation of memristor-based artificial neural networks
Aguirre, F., Sebastian, A., Le Gallo, M., Song, W., Wang, T., Yang, J. J., Lu, W., Chang, M.-F., Ielmini, D., Yang, Y., et al. (2024) · Nature Communications · doi:10.1038/s41467-024-45670-9 · Cited by 564
“(cid:129) Fixed Learningrate [178] (cid:129) Variable LearningRate paragraph ’ s explanation) and its variants (Gradient Descent with Momentum 165 ), (ii) Newton (analytically complex, as besides the gradient it also requires the Hessian matrix associated of the loss function) and Quasi-Newton methods (which operates…”
Conjugate Gradient Methods with Inexact Searches
Shanno, D. F. (1978) · Mathematics of Operations Research · doi:10.1287/moor.3.3.244 · Cited by 480
Golafshani, E. M., Behnood, A., & Arashpour, M. (2020) · Construction and Building Materials · doi:10.1016/j.conbuildmat.2019.117266 · Cited by 478
The NEWUOA software for unconstrained optimization without derivatives
Powell, M. J. D. (2006) · Nonconvex Optimization and Its Applications · doi:10.1007/0-387-30065-1_16 · Cited by 473
Three-dimensional magnetotelluric inversion using non-linear conjugate gradients
Newman, G. A., & Alumbaugh, D. L. (2000) · Geophysical Journal International · doi:10.1046/j.1365-246x.2000.00007.x · Cited by 455
Dynamics of ligand binding to heme proteins
Case, D. A., & Karplus, M. (1979) · Journal of Molecular Biology · doi:10.1016/0022-2836(79)90265-1 · Cited by 442
Concus, P., Golub, G. H., & O'Leary, D. P. (1976) · Sparse Matrix Computations · doi:10.1016/b978-0-12-141050-6.50023-4 · Cited by 433
JDFTx: Software for joint density-functional theory
Sundararaman, R., Letchworth-Weaver, K., Schwarz, K. A., Gunceler, D., Ozhabes, Y., & Arias, T. A. (2017) · SoftwareX · doi:10.1016/j.softx.2017.10.006 · Cited by 414
Near-Surface Applied Geophysics
Everett, M. E. (2013) · Cambridge University Press eBooks · doi:10.1017/cbo9781139088435 · Cited by 381
〈110〉 symmetric tilt grain-boundary structures in fcc metals with low stacking-fault energies
Rittner, J. D., & Seidman, D. N. (1996) · Physical Review B · doi:10.1103/physrevb.54.6999 · Cited by 379
Box, M. J. (1966) · The Computer Journal · doi:10.1093/comjnl/9.1.67 · Cited by 372
Brown, K. M., & Dennis, J. E. (1971) · Numerische Mathematik · doi:10.1007/bf01404679 · Cited by 370
Dud, A Derivative-Free Algorithm for Nonlinear Least Squares
Ralston, M. L., & Jennrich, R. I. (1978) · Technometrics · doi:10.1080/00401706.1978.10489610 · Cited by 364
Real time wave forecasting using neural networks
Deo, M. C., & Sridhar Naidu, C. (1998) · Ocean Engineering · doi:10.1016/s0029-8018(97)10025-7 · Cited by 360
Schlegel, H. B. (2011) · WIREs Computational Molecular Science · doi:10.1002/wcms.34 · Cited by 360
Kinematics in Young Star Clusters and Associations with Gaia DR2
Kuhn, M. A., Hillenbrand, L. A., Sills, A., Feigelson, E. D., & Getman, K. V. (2019) · The Astrophysical Journal · doi:10.3847/1538-4357/aaef8c · Cited by 356
A survey of model reference adaptive techniques—Theory and applications
Landau, I. D. (1974) · Automatica · doi:10.1016/0005-1098(74)90064-8 · Cited by 349
An Integrated Framework for the Spatio–Temporal–Spectral Fusion of Remote Sensing Images
Shen, H., Meng, X., & Zhang, L. (2016) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2016.2596290 · Cited by 341
Theory of algorithms for unconstrained optimization
Nocedal, J. (1992) · Acta Numerica · doi:10.1017/s0962492900002270 · Cited by 333
Causes of ice age intensification across the Mid-Pleistocene Transition
Chalk, T. B., Hain, M. P., Foster, G. L., Rohling, E. J., Sexton, P. F., Badger, M. P. S., Cherry, S. G., Hasenfratz, A. P., Haug, G. H., Jaccard, S. L., et al. (2017) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1702143114 · Cited by 326
Strategic approaches to drug design. I. An integrated software framework for molecular modelling
Vinter, J. G., Davis, A., & Saunders, M. R. (1987) · Journal of Computer-Aided Molecular Design · doi:10.1007/bf01680556 · Cited by 322
Auto-Encoders in Deep Learning—A Review with New Perspectives
Chen, S., & Guo, W. (2023) · Mathematics · doi:10.3390/math11081777 · Cited by 318
Autonomous Discovery in the Chemical Sciences Part I: Progress
Coley, C. W., Eyke, N. S., & Jensen, K. F. (2020) · Angewandte Chemie International Edition · doi:10.1002/anie.201909987 · Cited by 317
A Nonlinear Conjugate Gradient Algorithm with an Optimal Property and an Improved Wolfe Line Search
Dai, Y.-H., & Kou, C.-X. (2013) · SIAM Journal on Optimization · doi:10.1137/100813026 · Cited by 308
Numerical Methods for Electronic Structure Calculations of Materials
Saad, Y., Chelikowsky, J. R., & Shontz, S. M. (2010) · SIAM Review · doi:10.1137/060651653 · Cited by 301
NONLINEAR DYNAMICAL SYSTEM IDENTIFICATION FROM UNCERTAIN AND INDIRECT MEASUREMENTS
VOSS, H. U., TIMMER, J., & KURTHS, J. (2004) · International Journal of Bifurcation and Chaos · doi:10.1142/s0218127404010345 · Cited by 293
Zhang, L., Zhou, W., & Li, D. (2006) · Numerische Mathematik · doi:10.1007/s00211-006-0028-z · Cited by 292
Improvement of the backpropagation algorithm for training neural networks
Leonard, J., & Kramer, M. A. (1990) · Computers & Chemical Engineering · doi:10.1016/0098-1354(90)87070-6 · Cited by 287
Three-Dimensional Electromagnetic Modelling and Inversion from Theory to Application
Avdeev, D. B. (2005) · Surveys in Geophysics · doi:10.1007/s10712-005-1836-x · Cited by 276
Optimization of orbitals for multiconfigurational reference states
Dalgaard, E., & Jo/rgensen, P. (1978) · The Journal of Chemical Physics · doi:10.1063/1.437049 · Cited by 275
Seismic Structure of the Upper Mantle Beneath Eastern Asia From Full Waveform Seismic Tomography
Tao, K., Grand, S. P., & Niu, F. (2018) · Geochemistry, Geophysics, Geosystems · doi:10.1029/2018gc007460 · Cited by 265
A review of nonlinear FFT-based computational homogenization methods
Schneider, M. (2021) · Acta Mechanica · doi:10.1007/s00707-021-02962-1 · Cited by 265
The CRC Handbook of Mechanical Engineering
(2004) · CRC Press eBooks · doi:10.1201/9781420041583 · Cited by 260
Liu, Q.-F., Iqbal, M. F., Yang, J., Lu, X.-Y., Zhang, P., & Rauf, M. (2021) · Construction and Building Materials · doi:10.1016/j.conbuildmat.2020.121082 · Cited by 259
Optimization techniques on Riemannian manifolds
Smith, S. (1995) · Hamiltonian and Gradient Flows, Algorithms and Control · doi:10.1090/fic/003/09 · Cited by 258
High-resolution structure and strain comparison of infectious mammalian prions
Kraus, A., Hoyt, F., Schwartz, C. L., Hansen, B., Artikis, E., Hughson, A. G., Raymond, G. J., Race, B., Baron, G. S., & Caughey, B. (2021) · Molecular Cell · doi:10.1016/j.molcel.2021.08.011 · Cited by 258
Inositol phosphates are assembly co-factors for HIV-1
Dick, R. A., Zadrozny, K. K., Xu, C., Schur, F. K. M., Lyddon, T. D., Ricana, C. L., Wagner, J. M., Perilla, J. R., Ganser-Pornillos, B. K., Johnson, M. C., et al. (2018) · Nature · doi:10.1038/s41586-018-0396-4 · Cited by 253
Gradient methods for variational optimization of projected entangled-pair states
Vanderstraeten, L., Haegeman, J., Corboz, P., & Verstraete, F. (2016) · Physical Review B · doi:10.1103/physrevb.94.155123 · Cited by 206
Matrix product states and variational methods applied to critical quantum field theory
Milsted, A., Haegeman, J., & Osborne, T. J. (2013) · Physical Review D · doi:10.1103/physrevd.88.085030 · Cited by 88
Rizkin, B. A., Popovich, K., & Hartman, R. L. (2019) · Computers & Chemical Engineering · doi:10.1016/j.compchemeng.2018.11.016 · Cited by 40
Fan, Q., Zhang, Z., & Huang, X. (2022) · Advanced Theory and Simulations · doi:10.1002/adts.202200047 · Cited by 41
Aguirre, F. L., Pazos, S. M., Palumbo, F., Sune, J., & Miranda, E. (2020) · IEEE Access · doi:10.1109/access.2020.3035638 · Cited by 36
Quantification of the Impact of Structure Quality on Predicted Binding Free Energy Accuracy
Behera, S., Hahn, D. F., Wilson, C. J., Marsili, S., Tresadern, G., Gapsys, V., & de Groot, B. L. (2025) · Journal of Chemical Information and Modeling · doi:10.1021/acs.jcim.5c00947 · Cited by 14
State-to-State Cosmology: A New View on the Cosmological Arrow of Time and the Past Hypothesis
Deutsch, J. M., & Aguirre, A. (2022) · Foundations of Physics · doi:10.1007/s10701-022-00597-3 · Cited by 3
“using the same Fletcher Reeves conjugate gradient algorithm as above [22].”
Method
Metadata
- Authors
- Fletcher, R.
- Venue
- The Computer Journal
- Publisher
- Oxford University Press (OUP)
- Published
- 1964-02-01
- Volume
- 7
- Issue
- 2
- Pages
- 149-154
- ISSN
- 0010-4620 (ISSN-L)
- 1460-2067
- OpenAlex
- W2012231377
- Cited by
- 4,939
- References
- 0
- FWCI
- 12.62
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.