The DOI matches its OpenAlex record; 20 of the 20 references it cites were found in a registry or an index.
Gradient Descent Provably Optimizes Over-parameterized Neural Networks
Open accessOverview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Understanding deep learning requires rethinking generalization
Zhang, C., Bengio, S., Hardt, M., Recht, B., & Vinyals, O. (2016) · arXiv · doi:10.48550/arxiv.1611.03530 · Cited by 2,838 · cited 1×
“In Zhang et al. [2016], authors replaced the true labels with randomly generated labels, but still found randomly initialized first order methods can always achieve zero training loss.”
BackgroundTheoretical Insights Into the Optimization Landscape of Over-Parameterized Shallow Neural Networks
Soltanolkotabi, M., Javanmard, A., & Lee, J. D. (2019) · IEEE Transactions on Information Theory · doi:10.1109/tit.2018.2854560 · Cited by 356
Spurious Local Minima are Common in Two-Layer ReLU Neural NetworksPreprint
Safran, I., & Shamir, O. (2017) · International Conference on Machine Learning · doi:10.48550/arxiv.1712.08968 · Cited by 297
On the Power of Over-parametrization in Neural Networks with Quadratic ActivationPreprint
Du, S., & Lee, J. (2018) · International Conference on Machine Learning · doi:10.48550/arxiv.1803.01206 · Cited by 296
Self-citationNo bad local minima: Data independent training error guarantees for multilayer neural networksPreprint
Soudry, D., & Carmon, Y. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1605.08361 · Cited by 231
The loss surface of deep and wide neural networksPreprint
Nguyen, Q., & Hein, M. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1704.08045 · Cited by 212
Learning One-hidden-layer Neural Networks with Landscape DesignPreprint
Ge, R., Lee, J. D., & Ma, T. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1711.00501 · Cited by 210
Stochastic Subgradient Method Converges on Tame Functions
Davis, D., Drusvyatskiy, D., Kakade, S., & Lee, J. D. (2020) · Foundations of Computational Mathematics · doi:10.1007/s10208-018-09409-5 · Cited by 181
On the Optimization of Deep Networks: Implicit Acceleration by OverparameterizationPreprint
Arora, S., Cohen, N., & Hazan, E. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1802.06509 · Cited by 170
Tian, Y. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1703.00560 · Cited by 145
Cited by
Fourier Features Let Networks Learn High Frequency Functions in Low Dimensional Domains
Tancik, M., Srinivasan, P. P., Mildenhall, B., Fridovich-Keil, S., Raghavan, N., Singhal, U., Ramamoorthi, R., Barron, J. T., & Ng, R. (2020) · arXiv · doi:10.48550/arxiv.2006.10739 · Cited by 1,459
Correlation Congruence for Knowledge Distillation
Peng, B., Jin, X., Li, D., Zhou, S., Wu, Y., Liu, J., Zhang, Z., & Liu, Y. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00511 · Cited by 570
Surprises in high-dimensional ridgeless least squares interpolation
Hastie, T., Montanari, A., Rosset, S., & Tibshirani, R. J. (2022) · The Annals of Statistics · doi:10.1214/21-aos2133 · Cited by 503
Hoefler, T., Alistarh, D., Ben-Nun, T., Dryden, N., & Peste, A. (2021) · ETH Zurich · doi:10.3929/ethz-b-000519202 · Cited by 423
FedBN: Federated Learning on Non-IID Features via Local Batch Normalization
Li, X., Jiang, M., Zhang, X., Kamp, M., & Dou, Q. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2102.07623 · Cited by 332
Metadata
- Authors
- Du, S. S., Zhai, X., Póczos, B., & Singh, A.
- Venue
- arXiv (Cornell University)
- Publisher
- Cornell University
- Published
- 2018-10-04
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1810.02054
- OpenAlex
- W2894604724
- Cited by
- 344
- References
- 20
- Type
- posted content
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Gradient Descent Provably Optimizes Over-parameterized Neural Networks. https://app.cochat.ai/papers/10.48550/arxiv.1810.02054
- The paper
- Du, S. S., Zhai, X., Póczos, B., & Singh, A. (2018). Gradient Descent Provably Optimizes Over-parameterized Neural Networks. arXiv (Cornell University). https://doi.org/10.48550/arxiv.1810.02054
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.