The DOI matches its Crossref record.
Methods of conjugate gradients for solving linear systems
Open accessAbstract
An iterative algorithm is given for solving a system Ax=k of n linear equations in n unknowns. The solution is given in n steps. It is shown that this method is a special case of a very general method which also includes Gaussian elimination. These general algorithms are essentially algorithms for finding an n dimensional ellipsoid. Connections are made with the theory of orthogonal polynomials and continued fractions.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cited by
Deep learning in neural networks: an overview
Schmidhuber, J. (2015) · Neural Networks · doi:10.1016/j.neunet.2014.09.003 · Cited by 18,570
Iterative Methods for Sparse Linear Systems
Saad, Y. (2003) · Society for Industrial and Applied Mathematics eBooks · doi:10.1137/1.9780898718003 · Cited by 13,790
Phosphorene: An Unexplored 2D Semiconductor with a High Hole Mobility
Liu, H., Neal, A. T., Zhu, Z., Luo, Z., Xu, X., Tománek, D., & Ye, P. D. (2014) · ACS Nano · doi:10.1021/nn501226z · Cited by 6,480
LSQR: An Algorithm for Sparse Linear Equations and Sparse Least Squares
Paige, C. C., & Saunders, M. A. (1982) · ACM Transactions on Mathematical Software · doi:10.1145/355984.355989 · Cited by 4,387
Templates for the Solution of Linear Systems: Building Blocks for Iterative Methods
Barrett, R., Berry, M., Chan, T. F., Demmel, J., Donato, J., Dongarra, J., Eijkhout, V., Pozo, R., Romine, C., & van der Vorst, H. (1994) · Society for Industrial and Applied Mathematics eBooks · doi:10.1137/1.9781611971538 · Cited by 3,479
Supervised Sequence Labelling with Recurrent Neural Networks
Graves, A. (2012) · Studies in Computational Intelligence · doi:10.1007/978-3-642-24797-2 · Cited by 3,120
Introduction to the Finite Element Method
(2021) · Finite Element Method for Solids and Structures · doi:10.1017/9781108683982.002 · Cited by 2,933
The Geometry of Algorithms with Orthogonality Constraints
Edelman, A., Arias, T. A., & Smith, S. T. (1998) · SIAM Journal on Matrix Analysis and Applications · doi:10.1137/s0895479895290954 · Cited by 2,685
Wold, S., Ruhe, A., Wold, H., & Dunn, III (1984) · SIAM Journal on Scientific and Statistical Computing · doi:10.1137/0905052 · Cited by 2,529
Graph Regularized Nonnegative Matrix Factorization for Data Representation
Cai, D., He, X., Han, J., & Huang, T. S. (2011) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2010.231 · Cited by 2,451
Multiplier and gradient methods
Hestenes, M. R. (1969) · Journal of Optimization Theory and Applications · doi:10.1007/bf00927673 · Cited by 2,446
Self-citationNumerical solution of saddle point problems
Benzi, M., Golub, G. H., & Liesen, J. (2005) · Acta Numerica · doi:10.1017/s0962492904000212 · Cited by 2,300
Godara, L. C. (1997) · Proceedings of the IEEE · doi:10.1109/5.622504 · Cited by 2,073
Jacobian-free Newton–Krylov methods: a survey of approaches and applications
Knoll, D. A., & Keyes, D. E. (2004) · Journal of Computational Physics · doi:10.1016/j.jcp.2003.08.010 · Cited by 1,930
Optimization methods for finding minimum energy paths
Sheppard, D., Terrell, R., & Henkelman, G. (2008) · The Journal of Chemical Physics · doi:10.1063/1.2841941 · Cited by 1,859
Optimization Algorithms on Matrix Manifolds
Absil, P.-A., Mahony, R., & Sepulchre, R. (2008) · Princeton University Press eBooks · doi:10.1515/9781400830244 · Cited by 1,840
Solution of Sparse Indefinite Systems of Linear Equations
Paige, C. C., & Saunders, M. A. (1975) · SIAM Journal on Numerical Analysis · doi:10.1137/0712047 · Cited by 1,620
A strategy for operational implementation of 4D‐Var, using an incremental approach
Courtier, P., Thépaut, J. ‐., & Hollingsworth, A. (1994) · Quarterly Journal of the Royal Meteorological Society · doi:10.1002/qj.49712051912 · Cited by 1,612
Deformable medical image registration: a survey
Sotiras, A., Davatzikos, C., & Paragios, N. (2013) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2013.2265603 · Cited by 1,587
“Among the well-known formulas for β t , one may cite the Fletcher-Reeves [404], the Polak-Ribi`ere [405], the Polak-Ribi`ere-Polyak [406] and the Hestenes-Stiefel [407].”
MethodZhou, W., Nielsen, J. B., Fritsche, L. G., Dey, R., Gabrielsen, M. E., Wolford, B. N., LeFaive, J., VandeHaar, P., Gagliano, S. A., Gifford, A., et al. (2018) · Nature Genetics · doi:10.1038/s41588-018-0184-y · Cited by 1,544
Riemann manifold langevin and hamiltonian monte carlo methods
Girolami, M., & Calderhead, B. (2011) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.1467-9868.2010.00765.x · Cited by 1,473
Nonlinear conjugate gradients algorithm for 2-D magnetotelluric inversion
Rodi, W., & Mackie, R. L. (2001) · Geophysics · doi:10.1190/1.1444893 · Cited by 1,384
Preconditioning Techniques for Large Linear Systems: A Survey
Benzi, M. (2002) · Journal of Computational Physics · doi:10.1006/jcph.2002.7176 · Cited by 1,221
Advances in sensitivity encoding with arbitrary k‐space trajectories
Pruessmann, K. P., Weiger, M., Börnert, P., & Boesiger, P. (2001) · Magnetic Resonance in Medicine · doi:10.1002/mrm.1241 · Cited by 1,211
Semiconducting Layered Blue Phosphorus: A Computational Study
Zhu, Z., & Tománek, D. (2014) · Physical Review Letters · doi:10.1103/physrevlett.112.176802 · Cited by 1,195
The conjugate gradient method in extremal problems
Polyak, B. T. (1969) · USSR Computational Mathematics and Mathematical Physics · doi:10.1016/0041-5553(69)90035-4 · Cited by 1,164
Learning and generalization characteristics of the random vector functional-link net
Pao, Y.-H., Park, G.-H., & Sobajic, D. J. (1994) · Neurocomputing · doi:10.1016/0925-2312(94)90053-1 · Cited by 1,138
Solution of Schrödinger’s equation for large systems
Teter, M. P., Payne, M. C., & Allan, D. C. (1989) · Physical Review B · doi:10.1103/physrevb.40.12255 · Cited by 1,115
Overview and Recent Advances in Partial Least Squares
Rosipal, R., & Krämer, N. (2006) · Lecture Notes in Computer Science · doi:10.1007/11752790_2 · Cited by 1,091
Note sur la convergence de méthodes de directions conjuguées
Polak, E., & Ribiere, G. (1969) · Revue française d'informatique et de recherche opérationnelle. Série rouge · doi:10.1051/m2an/196903r100351 · Cited by 986
Numerical Methods for Image Registration
Modersitzki, J. (2003) · doi:10.1093/acprof:oso/9780198528418.001.0001 · Cited by 923
Elements of Artificial Neural Networks
Mehrotra, K., Mohan, C., & Ranka, S. (1996) · The MIT Press eBooks · doi:10.7551/mitpress/2687.001.0001 · Cited by 912
Gradient-based optimizer: A new metaheuristic optimization algorithm
Ahmadianfar, I., Bozorg-Haddad, O., & Chu, X. (2020) · Information Sciences · doi:10.1016/j.ins.2020.06.037 · Cited by 904
Variable Metric Method for Minimization
Davidon, W. C. (1991) · SIAM Journal on Optimization · doi:10.1137/0801001 · Cited by 892
A Survey on Distributed Machine Learning
Verbraeken, J., Wolting, M., Katzy, J., Kloppenburg, J., Verbelen, T., & Rellermeyer, J. S. (2021) · ACM Computing Surveys · doi:10.1145/3377454 · Cited by 872
On the use of deep learning for computational imaging
Barbastathis, G., Ozcan, A., & Situ, G. (2019) · Optica · doi:10.1364/optica.6.000921 · Cited by 869
The Conjugate Gradient Method and Trust Regions in Large Scale Optimization
Steihaug, T. (1983) · SIAM Journal on Numerical Analysis · doi:10.1137/0720042 · Cited by 824
General Framework for Dynamic Substructuring: History, Review and Classification of Techniques
de Klerk, D., Rixen, D. J., & Voormeeren, S. N. (2008) · AIAA Journal · doi:10.2514/1.33274 · Cited by 823
Paatero, P. (1999) · Journal of Computational and Graphical Statistics · doi:10.1080/10618600.1999.10474853 · Cited by 756
Self-Driving Laboratories for Chemistry and Materials Science
Tom, G., Schmid, S. P., Baird, S. G., Cao, Y., Darvish, K., Hao, H., Lo, S., Pablo-García, S., Rajaonson, E. M., Skreta, M., et al. (2024) · Chemical Reviews · doi:10.1021/acs.chemrev.4c00055 · Cited by 707
Phase Coexistence and Metal-Insulator Transition in Few-Layer Phosphorene: A Computational Study
Guan, J., Zhu, Z., & Tománek, D. (2014) · Physical Review Letters · doi:10.1103/physrevlett.113.046804 · Cited by 671
de Rochefort, L., Liu, T., Kressler, B., Liu, J., Spincemaille, P., Lebon, V., Wu, J., & Wang, Y. (2010) · Magnetic Resonance in Medicine · doi:10.1002/mrm.22187 · Cited by 670
Problem formulations and solvers in linear SVM: a review
Chauhan, V. K., Dahiya, K., & Sharma, A. (2019) · Artificial Intelligence Review · doi:10.1007/s10462-018-9614-6 · Cited by 660
An efficient 3D topology optimization code written in Matlab
Liu, K., & Tovar, A. (2014) · Structural and Multidisciplinary Optimization · doi:10.1007/s00158-014-1107-x · Cited by 649
Adaptive Restart for Accelerated Gradient Schemes
O’Donoghue, B., & Candès, E. (2015) · Foundations of Computational Mathematics · doi:10.1007/s10208-013-9150-3 · Cited by 642
Deep Learning and Its Applications in Biomedicine
Cao, C., Liu, F., Tan, H., Song, D., Shu, W., Li, W., Zhou, Y., Bo, X., & Xie, Z. (2018) · Genomics, Proteomics & Bioinformatics · doi:10.1016/j.gpb.2017.07.003 · Cited by 624
Metaheuristic design of feedforward neural networks: A review of two decades of research
Ojha, V. K., Abraham, A., & Snášel, V. (2017) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2017.01.013 · Cited by 606
Amato, F., Pandolfi, M., Escrig, A., Querol, X., Alastuey, A., Pey, J., Perez, N., & Hopke, P. K. (2009) · Atmospheric Environment · doi:10.1016/j.atmosenv.2009.02.039 · Cited by 584
PyCUDA and PyOpenCL: A scripting-based approach to GPU run-time code generation
Klöckner, A., Pinto, N., Lee, Y., Catanzaro, B., Ivanov, P., & Fasih, A. (2012) · Parallel Computing · doi:10.1016/j.parco.2011.09.001 · Cited by 573
The lattice gauge theory approach to quantum chromodynamics
Kogut, J. B. (1983) · Reviews of Modern Physics · doi:10.1103/revmodphys.55.775 · Cited by 555
Learning similarity with cosine similarity ensemble
Xia, P., Zhang, L., & Li, F. (2015) · Information Sciences · doi:10.1016/j.ins.2015.02.024 · Cited by 552
Gradient Theory of Optimal Flight Paths
KELLEY, H. J. (1960) · ARS Journal · doi:10.2514/8.5282 · Cited by 542
Saad, E. W., Prokhorov, D. V., & Wunsch, D. C. (1998) · IEEE Transactions on Neural Networks · doi:10.1109/72.728395 · Cited by 537
Variational mesh for quantum-mechanical simulations
Pederson, M. R., & Jackson, K. A. (1990) · Physical Review B · doi:10.1103/physrevb.41.7453 · Cited by 516
Firedrake: Automating the Finite Element Method by Composing Abstractions
Rathgeber, F., Ham, D. A., Mitchell, L., Lange, M., Luporini, F., Mcrae, A. T. T., Bercea, G.-T., Markall, G. R., & Kelly, P. H. J. (2017) · ACM Transactions on Mathematical Software · doi:10.1145/2998441 · Cited by 508
A fast algorithm for matrix balancing
Knight, P. A., & Ruiz, D. (2013) · IMA Journal of Numerical Analysis · doi:10.1093/imanum/drs019 · Cited by 507
Liu, J., Liu, T., de Rochefort, L., Ledoux, J., Khalidov, I., Chen, W., Tsiouris, A. J., Wisnieff, C., Spincemaille, P., Prince, M. R., et al. (2012) · NeuroImage · doi:10.1016/j.neuroimage.2011.08.082 · Cited by 498
A review of cooperative multi-agent deep reinforcement learning
Oroojlooy, A., & Hajinezhad, D. (2023) · Applied Intelligence · doi:10.1007/s10489-022-04105-y · Cited by 482
Conjugate Gradient Methods with Inexact Searches
Shanno, D. F. (1978) · Mathematics of Operations Research · doi:10.1287/moor.3.3.244 · Cited by 480
Kamensky, D., Hsu, M.-C., Schillinger, D., Evans, J. A., Aggarwal, A., Bazilevs, Y., Sacks, M. S., & Hughes, T. J. R. (2015) · Computer Methods in Applied Mechanics and Engineering · doi:10.1016/j.cma.2014.10.040 · Cited by 470
A Parallel Multigrid Preconditioned Conjugate Gradient Algorithm for Groundwater Flow Simulations
Ashby, S. F., & Falgout, R. D. (1996) · Nuclear Science and Engineering · doi:10.13182/nse96-a24230 · Cited by 462
Three-dimensional magnetotelluric inversion using non-linear conjugate gradients
Newman, G. A., & Alumbaugh, D. L. (2000) · Geophysical Journal International · doi:10.1046/j.1365-246x.2000.00007.x · Cited by 455
Entropy search for information-efficient global optimization
Hennig, P., & Schuler, C. J. (2012) · Journal of Machine Learning Research · doi:10.5555/2188385.2343701 · Cited by 443
Shaping regularization in geophysical-estimation problems
Fomel, S. (2007) · Geophysics · doi:10.1190/1.2433716 · Cited by 435
Iterative solution of linear systems
Freund, R. W., Golub, G. H., & Nachtigal, N. M. (1992) · Acta Numerica · doi:10.1017/s0962492900002245 · Cited by 434
Concus, P., Golub, G. H., & O'Leary, D. P. (1976) · Sparse Matrix Computations · doi:10.1016/b978-0-12-141050-6.50023-4 · Cited by 433
Klein, S., Staring, M., & Pluim, J. P. W. (2007) · IEEE Transactions on Image Processing · doi:10.1109/tip.2007.909412 · Cited by 431
L1-L2 Optimization in Signal and Image Processing
Zibulevsky, M., & Elad, M. (2010) · IEEE Signal Processing Magazine · doi:10.1109/msp.2010.936023 · Cited by 426
Truncated-Newton algorithms for large-scale unconstrained optimization
Dembo, R. S., & Steihaug, T. (1983) · Mathematical Programming · doi:10.1007/bf02592055 · Cited by 420
Analysis of the Inexact Uzawa Algorithm for Saddle Point Problems
Bramble, J. H., Pasciak, J. E., & Vassilev, A. T. (1997) · SIAM Journal on Numerical Analysis · doi:10.1137/s0036142994273343 · Cited by 406
Mutiso, R. M., Sherrott, M. C., Rathmell, A. R., Wiley, B. J., & Winey, K. I. (2013) · ACS Nano · doi:10.1021/nn403324t · Cited by 400
Stable architectures for deep neural networks
Haber, E., & Ruthotto, L. (2018) · Inverse Problems · doi:10.1088/1361-6420/aa9a90 · Cited by 397
Low-dose CT reconstruction via edge-preserving total variation regularization
Tian, Z., Jia, X., Yuan, K., Pan, T., & Jiang, S. B. (2011) · Physics in Medicine and Biology · doi:10.1088/0031-9155/56/18/011 · Cited by 396
The Scope and Limitations of Curve Fitting
Maddams, W. F. (1980) · Applied Spectroscopy · doi:10.1366/0003702804730312 · Cited by 392
Multiphysics simulations: Challenges and opportunities
Keyes, D. E., McInnes, L. C., Woodward, C., Gropp, W., Myra, E., Pernice, M., Bell, J., Brown, J., Clo, A., Connors, J., et al. (2013) · The International Journal of High Performance Computing Applications · doi:10.1177/1094342012468181 · Cited by 389
AdaBelief Optimizer: Adapting Stepsizes by the Belief in Observed Gradients
Zhuang, J., Tang, T., Ding, Y., Tatikonda, S., Dvornek, N., Papademetris, X., & Duncan, J. S. (2020) · arXiv · doi:10.48550/arxiv.2010.07468 · Cited by 382
Near-Surface Applied Geophysics
Everett, M. E. (2013) · Cambridge University Press eBooks · doi:10.1017/cbo9781139088435 · Cited by 381
Langevin simulations of lattice field theories
Batrouni, G. G., Katz, G. R., Kronfeld, A. S., Lepage, G. P., Svetitsky, B., & Wilson, K. G. (1985) · Physical Review D · doi:10.1103/physrevd.32.2736 · Cited by 380
Phoenics: A Bayesian Optimizer for Chemistry
Häse, F., Roch, L. M., Kreisbeck, C., & Aspuru-Guzik, A. (2018) · ACS Central Science · doi:10.1021/acscentsci.8b00307 · Cited by 379
Frenkel-defected monolayer MoS2 catalysts for efficient hydrogen evolution
Xu, J., Shao, G., Tang, X., Lv, F., Xiang, H., Jing, C., Liu, S., Dai, S., Li, Y., Luo, J., et al. (2022) · Nature Communications · doi:10.1038/s41467-022-29929-7 · Cited by 378
Interior point methods 25 years later
Gondzio, J. (2012) · European Journal of Operational Research · doi:10.1016/j.ejor.2011.09.017 · Cited by 377
Recent computational developments in Krylov subspace methods for linear systems
Simoncini, V., & Szyld, D. B. (2007) · Numerical Linear Algebra with Applications · doi:10.1002/nla.499 · Cited by 375
Whole mantle P-wave travel time tomography
Inoue, H., Fukao, Y., Tanabe, K., & Ogata, Y. (1990) · Physics of the Earth and Planetary Interiors · doi:10.1016/0031-9201(90)90236-q · Cited by 375
Labat, F., Baranek, P., Domain, C., Minot, C., & Adamo, C. (2007) · The Journal of Chemical Physics · doi:10.1063/1.2717168 · Cited by 373
Conjugate Gradient-Type Methods for Linear Systems with Complex Symmetric Coefficient Matrices
Freund, R. W. (1992) · SIAM Journal on Scientific and Statistical Computing · doi:10.1137/0913023 · Cited by 371
Discrete logarithms in finite fields and their cryptographic significance
Odlyzko, A. M. (2007) · Lecture Notes in Computer Science · doi:10.1007/3-540-39757-4_20 · Cited by 367
Recent Developments in Algorithms and Software for Trust Region Methods
Moré, J. J. (1983) · Mathematical Programming The State of the Art · doi:10.1007/978-3-642-68874-4_11 · Cited by 359
Mackie, R. L., Smith, J. T., & Madden, T. R. (1994) · Radio Science · doi:10.1029/94rs00326 · Cited by 354
Analysis of two partial-least-squares algorithms for multivariate calibration
Manne, R. (1987) · Chemometrics and Intelligent Laboratory Systems · doi:10.1016/0169-7439(87)80096-5 · Cited by 350
Newton-Type Minimization via the Lanczos Method
Nash, S. G. (1984) · SIAM Journal on Numerical Analysis · doi:10.1137/0721052 · Cited by 338
Handbook of Mathematical Methods in Imaging
(2011) · Springer eBooks · doi:10.1007/978-0-387-92920-0 · Cited by 334
Frequency‐domain modelling of airborne electromagnetic responses using staggered finite differences1
Newman, G. A., & Alumbaugh, D. L. (1995) · Geophysical Prospecting · doi:10.1111/j.1365-2478.1995.tb00294.x · Cited by 331
Parallel magnetic resonance imaging
Larkman, D. J., & Nunes, R. G. (2007) · Physics in Medicine and Biology · doi:10.1088/0031-9155/52/7/r01 · Cited by 327
Review of numerical optimization techniques for meta-device design [Invited]
Campbell, S. D., Sell, D., Jenkins, R. P., Whiting, E. B., Fan, J. A., & Werner, D. H. (2019) · Optical Materials Express · doi:10.1364/ome.9.001842 · Cited by 322
Auto-Encoders in Deep Learning—A Review with New Perspectives
Chen, S., & Guo, W. (2023) · Mathematics · doi:10.3390/math11081777 · Cited by 318
Björck, Å. (1990) · Handbook of Numerical Analysis · doi:10.1016/s1570-8659(05)80036-5 · Cited by 313
Kogut, J., Stone, M., Wyld, H. W., Gibbs, W. R., Shigemitsu, J., Shenker, S. H., & Sinclair, D. K. (1983) · Physical Review Letters · doi:10.1103/physrevlett.50.393 · Cited by 312
The 2017 IEEE International Conference on Fuzzy Systems
(2016) · IEEE Computational Intelligence Magazine · doi:10.1109/mci.2016.2545826 · Cited by 308
A Nonlinear Conjugate Gradient Algorithm with an Optimal Property and an Improved Wolfe Line Search
Dai, Y.-H., & Kou, C.-X. (2013) · SIAM Journal on Optimization · doi:10.1137/100813026 · Cited by 308
Numerical Methods for Electronic Structure Calculations of Materials
Saad, Y., Chelikowsky, J. R., & Shontz, S. M. (2010) · SIAM Review · doi:10.1137/060651653 · Cited by 301
Metadata
- Authors
- Hestenes, M. R., & Stiefel, E.
- Venue
- Journal of Research of the National Bureau of Standards
- Published
- 1952-12
- Volume
- 49
- Issue
- 6
- Pages
- 409
- ISSN
- 0091-0635 (ISSN-L)
- OpenAlex
- W2316564661
- Cited by
- 8,132
- References
- 0
- FWCI
- 12.48
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.