The DOI matches its OpenAlex record; 27 of the 27 references it cites were found in a registry or an index.
On Exact Computation with an Infinitely Wide Neural Net
Open accessOverview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification
He, K., Zhang, X., Ren, S., & Sun, J. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.123 · Cited by 19,741
Understanding deep learning requires rethinking generalization
Zhang, C., Bengio, S., Hardt, M., Recht, B., & Vinyals, O. (2016) · arXiv · doi:10.48550/arxiv.1611.03530 · Cited by 2,838 · cited 1×
“Furthermore, the infinite limit could conceivably make sense in deep learning, since over-parametrization seems to help optimization a lot and doesn’t hurt generalization much [Zhang et al., 2017]: deep neural nets with millions of parameters work well even for datasets with 50k training data points.”
BackgroundConcentration Inequalities: A Nonasymptotic Theory of Independence
Boucheron, S., Lugosi, G., & Massart, P. (2013) · doi:10.1093/acprof:oso/9780199535255.001.0001 · Cited by 1,768
Neural Tangent Kernel: Convergence and Generalization in Neural Networks
Jacot, A., Gabriel, F., & Hongler, C. (2018) · arXiv · doi:10.48550/arxiv.1806.07572 · Cited by 1,562
Kernel Methods for Deep Learning
Cho, Y., & Saul, L. K. (2009) · eScholarship (California Digital Library) · Cited by 722
A Convergence Theory for Deep Learning via Over-Parameterization
Allen-Zhu, Z., Li, Y., & Song, Z. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1811.03962 · Cited by 657
Learning and Generalization in Overparameterized Neural Networks, Going Beyond Two LayersPreprint
Allen-Zhu, Z., Li, Y., & Liang, Y. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1811.04918 · Cited by 587
Deep Neural Networks as Gaussian Processes
Lee, J., Bahri, Y., Novak, R., Schoenholz, S. S., Pennington, J., & Sohl‐Dickstein, J. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1711.00165 · Cited by 529
Yang, G. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1902.04760 · Cited by 332
Bayesian Deep Convolutional Networks with Many Channels are Gaussian ProcessesPreprint
Novak, R., Xiao, L., Lee, J., Bahri, Y., Yang, G., Hron, J., Abolafia, D. A., Pennington, J., & Sohl‐Dickstein, J. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1810.05148 · Cited by 306
Deep Convolutional Networks as shallow Gaussian ProcessesPreprint
Garriga-Alonso, A., Aitchison, L., & Rasmussen, C. E. (2018) · arXiv (Cornell University) · doi:10.17863/cam.42340 · Cited by 250
Arora, S., Du, S. S., Hu, W. P., Li, Z., & Wang, R. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1901.08584 · Cited by 210
Self-citationTo understand deep learning we need to understand kernel learning
Belkin, M., Ma, S., & Mandal, S. (2018) · arXiv · doi:10.48550/arxiv.1802.01396 · Cited by 201
Generalization Error Bounds of Gradient Descent for Learning Over-Parameterized Deep ReLU Networks
Cao, Y. J., & Gu, Q. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i04.5736 · Cited by 196
Daniely, A., Frostig, R., & Singer, Y. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1602.05897 · Cited by 178
Stochastic Gradient Descent Optimizes Over-parameterized Deep ReLU Networks
Zou, D., Cao, Y. J., Zhou, D., & Gu, Q. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1811.08888 · Cited by 175
A Selective Overview of Deep Learning
Fan, J., Ma, C., & Zhong, Y. (2021) · Statistical Science · doi:10.1214/20-sts783 · Cited by 166
Hierarchical Gaussian process latent variable models
Lawrence, N. D., & Moore, A. J. (2007) · Proceedings of the 24th international conference on Machine learning · doi:10.1145/1273496.1273557 · Cited by 162
Mairal, J., Koniusz, P., Harchaoui, Z., & Schmid, C. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1406.3332 · Cited by 158
SGD Learns the Conjugate Kernel Class of the NetworkPreprint
Daniely, A. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1702.08503 · Cited by 97
Steps Toward Deep Kernel Methods from Infinite Neural NetworksPreprint
Hazan, T., & Jaakkola, T. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1508.05133 · Cited by 81
A Note on Lazy Training in Supervised Differentiable ProgrammingPreprint
Chizat, L., & Bach, F. (2018) · arXiv (Cornell University) · Cited by 81
Learning Scalable Deep Kernels with Recurrent Structure
Al-Shedivat, M., Wilson, A. G., Saatchi, Y., Hu, Z., & Xing, E. P. (2016) · PubMed · doi:10.48550/arxiv.1610.08936 · Cited by 79
Width Provably Matters in Optimization for Deep Linear Neural NetworksPreprint
Du, S. S., & Hu, W. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1901.08572 · Cited by 54
Self-citationConvolutional Gaussian Processes
van der Wilk, M., Rasmussen, C. E., & Hensman, J. J. (2017) · Apollo (University of Cambridge) · doi:10.17863/cam.21271 · Cited by 44
Deep Gaussian Processes with Convolutional KernelsPreprint
Kumar, V., Singh, V. K., Srijith, P. K., & Damianou, A. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1806.01655 · Cited by 42
A Generalization Theory of Gradient Descent for Learning Over-parameterized Deep ReLU Networks
Cao, Y. J., & Gu, Q. (2019) · Cited by 37
Cited by
When and why PINNs fail to train: A neural tangent kernel perspective
Wang, S., Yu, X., & Perdikaris, P. (2022) · Journal of Computational Physics · doi:10.1016/j.jcp.2021.110768 · Cited by 1,496
Power of data in quantum machine learning
Huang, H.-Y., Broughton, M., Mohseni, M., Babbush, R., Boixo, S., Neven, H., & McClean, J. R. (2021) · Nature Communications · doi:10.1038/s41467-021-22539-9 · Cited by 896
Wang, S., Wang, H., & Perdikaris, P. (2021) · Computer Methods in Applied Mechanics and Engineering · doi:10.1016/j.cma.2021.113938 · Cited by 693
Machine learning and deep learning—A review for ecologists
Pichler, M., & Hartig, F. (2023) · Methods in Ecology and Evolution · doi:10.1111/2041-210x.14061 · Cited by 454
Towards Understanding Ensemble, Knowledge Distillation and Self-Distillation in Deep Learning
Allen-Zhu, Z., & Li, Y. (2020) · arXiv · doi:10.48550/arxiv.2012.09816 · Cited by 178
Metadata
- Authors
- Arora, S., Du, S. S., Hu, W. P., Li, Z., Salakhutdinov, R., & Wang, R.
- Venue
- arXiv (Cornell University)
- Publisher
- Cornell University
- Published
- 2019-04-26
- Volume
- 32
- Pages
- 8139-8148
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1904.11955
- OpenAlex
- W2942052807
- Cited by
- 358
- References
- 27
- Type
- posted content
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.