The DOI matches its Crossref record.
Some methods of speeding up the convergence of iteration methods
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Example 1.1 (Heavy-ball momentum gradient descent; Polyak [54]) . This optimizer can be written in the form (1) with”
From How Memory in Optimization Algorithms Implicitly Modifies the Loss (2025) · cites this paper as [54]
In the citing paper
“For example, gradient descent with momentum has exponentially decaying memory through exponentially averaged past gradients.”
From How Memory in Optimization Algorithms Implicitly Modifies the Loss (2025) · cites this paper as [54]
Citations
Cites
No references could be resolved yet.
Research works printed but not linked: 7
- Kantorovich, 1956, Approximate solution of functional equations, Uspekhi Mat. Nauk, 11, 99
- Gavurin, 1958, Nonlinear functional equations and continuous analogues of iterative methods, Izv. VUZov. Ser. Mat., 5, 18
- Buledz, 1961, The problem of speeding up the convergence of iteration processes in the approximate solution of linear operational equations, Dop. Akad. Nauk SSSR, 3, 265
- Frankel, 1950, Convergence rates of iterative treatments of partial differential equations, Math. Tables and Other Aids Comput., 4, 65, 10.2307/2002770 · DOI
- Polyak, 1963, Gradient methods for minimizing functionals, Zh. vych. mat., 3, 643
- Gel'fand, 1961, Principles of nonlocal search in systems of automatic optimization, Dokl. Akad. Nauk SSSR, 137, 295
- Inomata, 1961, On the golf method, Bu l. Electrotec. Lab., 25, 495
Cited by
Sorted by citations
Deep learning for cellular image analysis
Moen, E., Bannon, D., Kudo, T., Graf, W., Covert, M., & Van Valen, D. (2019) · Nature Methods · doi:10.1038/s41592-019-0403-1 · Cited by 1,225
Neural Network Methods for Natural Language Processing
Goldberg, Y. (2017) · Synthesis Lectures on Human Language Technologies · doi:10.1007/978-3-031-02165-7 · Cited by 821
A multiscale and multidepth convolutional neural network for remote sensing imagery pan-sharpening
Yuan, Q., Wei, Y., Meng, X., Shen, H., & Zhang, L. (2018) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2018.2794888 · Cited by 649
Ball, J. E., Anderson, D. T., & Chan, C. S. (2017) · Journal of Applied Remote Sensing · doi:10.1117/1.jrs.11.042609 · Cited by 746
Accelerating Federated Learning via Momentum Gradient Descent
Liu, W., Chen, L., Chen, Y., & Zhang, W. (2020) · IEEE Transactions on Parallel and Distributed Systems · doi:10.1109/tpds.2020.2975189 · Cited by 374
Why Can GPT Learn In-Context? Language Models Secretly Perform Gradient Descent as Meta-Optimizers
Dai, D., Sun, Y., Dong, L., Hao, Y., Ma, S., Sui, Z., & Wei, F. (2023) · Findings of the Association for Computational Linguistics: ACL 2023 · doi:10.18653/v1/2023.findings-acl.247 · Cited by 154
Forward Noise Adjustment Scheme for Data Augmentation
Moreno-Barea, F. J., Strazzera, F., Jerez, J. M., Urda, D., & Franco, L. (2018) · 2018 IEEE Symposium Series on Computational Intelligence (SSCI) · doi:10.1109/ssci.2018.8628917 · Cited by 158
Convolutional Neural Network for Multi-Category Rapid Serial Visual Presentation BCI
Manor, R., & Geva, A. B. (2015) · Frontiers in Computational Neuroscience · doi:10.3389/fncom.2015.00146 · Cited by 144
The cascading neural network: building the Internet of Smart Things
Leroux, S., Bohez, S., De Coninck, E., Verbelen, T., Vankeirsbilck, B., Simoens, P., & Dhoedt, B. (2017) · Knowledge and Information Systems · doi:10.1007/s10115-017-1029-1 · Cited by 59
Distributed Machine Learning through Heterogeneous Edge Systems
Hu, H., Wang, D., & Wu, C. (2019) · arXiv · doi:10.48550/arxiv.1911.06949 · Cited by 47
TextGrad: Automatic "Differentiation" via Text
Yuksekgonul, M., Bianchi, F., Boen, J., Liu, S., Huang, Z., Guestrin, C., & Zou, J. (2024) · arXiv · doi:10.48550/arxiv.2406.07496 · Cited by 12
How Memory in Optimization Algorithms Implicitly Modifies the Loss
Cattaneo, M., & Shigida, B. (2025) · Advances in Neural Information Processing Systems 38 · doi:10.52202/085713-5215
Metadata
- Authors
- Polyak, B. T.
- Corresponding author
- Polyak, B.T.
- ORCID
- Polyak, B.T.
- Venue
- USSR Computational Mathematics and Mathematical Physics
- Publisher
- Elsevier BV
- Published
- 1964-01
- Volume
- 4
- Issue
- 5
- Pages
- 1-17
- ISSN
- 0041-5553 (ISSN-L)
- OpenAlex
- W1988720110
- Cited by
- 3,069
- References
- 0
- Citations by year
- 2026: 345 · 2025: 426 · 2024: 368 · 2023: 354 · 2022: 313 · 2021: 389 · 2020: 301 · 2019: 234 · 2018: 124 · 2017: 87 · 2016: 58 · 2015: 33 · 2014: 11 · 2013: 3 · 2012: 3
- FWCI
- 0.00
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- USSR Computational Mathematics and Mathematical Physics (publishedVersion)
- Topics
- Physical Sciences › Mathematics › Numerical Analysis › Iterative Methods for Nonlinear Equations
- Physical Sciences › Computer Science › Computational Theory and Mathematics › Optimization and Variational Analysis
- Physical Sciences › Computer Science › Computational Theory and Mathematics › Matrix Theory and Algorithms
- Keywords
- convergence acceleration, iterative methods, multistep methods, Banach space operators, functional equations, ordinary differential equations, convergence rate, successive approximations, Hilbert spaces
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
