The DOI matches its Crossref record; 130 of the 130 references it cites were found in a registry or an index.
A high-bias, low-variance introduction to Machine Learning for physicists
Open accessAbstract
Machine Learning (ML) is one of the most exciting and dynamic areas of modern research and application. The purpose of this review is to provide an introduction to the core concepts and tools of machine learning in a manner easily understood and intuitive to physicists. The review begins by covering fundamental concepts in ML and modern statistics such as the bias-variance tradeoff, overfitting, regularization, generalization, and gradient descent before moving on to more advanced topics in both supervised and unsupervised learning. Topics covered in the review include ensemble models, deep learning and neural networks, clustering and data visualization, energy-based models (including MaxEnt models and Restricted Boltzmann Machines), and variational methods. Throughout, we emphasize the many natural connections between ML and statistical physics. A notable aspect of the review is the use of Python Jupyter notebooks to introduce modern ML/statistical packages to readers using physics-inspired datasets (the Ising Model and Monte-Carlo simulations of supersymmetric decays of proton-proton collisions). We conclude with an extended outlook discussing possible uses of machine learning for furthering our understanding of the physical world as well as open problems in ML where physicists may be able to contribute.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Breiman, L. (2001) · Machine Learning · doi:10.1023/a:1010933404324 · Cited by 133,538
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805
Boyd, S., & Vandenberghe, L. (2004) · doi:10.1017/cbo9780511804441 · Cited by 56,601
Maximum Likelihood from Incomplete Data Via the EM Algorithm
Dempster, A. P., Laird, N. M., & Rubin, D. B. (1977) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1977.tb01600.x · Cited by 50,444
Learning representations by back-propagating errors
Rumelhart, D. E., Hinton, G. E., & Williams, R. J. (1986) · Nature · doi:10.1038/323533a0 · Cited by 31,892
Greedy function approximation: A gradient boosting machine
Friedman, J. H. (2001) · The Annals of Statistics · doi:10.1214/aos/1013203451 · Cited by 30,731
Human-level control through deep reinforcement learning
Mnih, V., Kavukcuoglu, K., Silver, D., Rusu, A. A., Veness, J., Bellemare, M. G., Graves, A., Riedmiller, M., Fidjeland, A. K., Ostrovski, G., et al. (2015) · Nature · doi:10.1038/nature14236 · Cited by 30,357
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
Ioffe, S., & Szegedy, C. (2015) · arXiv · doi:10.48550/arxiv.1502.03167 · Cited by 27,818
The Elements of Statistical Learning
Hastie, T., Friedman, J., & Tibshirani, R. (2001) · Springer Series in Statistics · doi:10.1007/978-0-387-21606-5 · Cited by 24,162
Cited by
Parameterized quantum circuits as machine learning models
Benedetti, M., Lloyd, E., Sack, S., & Fiorentini, M. (2019) · Quantum Science and Technology · doi:10.1088/2058-9565/ab4eb5 · Cited by 1,144
Science Requirements and Detector Concepts for the Electron-Ion Collider
Abdul Khalek, R., Accardi, A., Adam, J., Adamiak, D., Akers, W., Albaladejo, M., Al-bataineh, A., Alexeev, M. G., Ameli, F., Antonioli, P., et al. (2022) · Nuclear Physics A · doi:10.1016/j.nuclphysa.2022.122447 · Cited by 913
Deep learning for molecular design—a review of the state of the art
Elton, D. C., Boukouvalas, Z., Fuge, M. D., & Chung, P. W. (2019) · Molecular Systems Design & Engineering · doi:10.1039/c9me00039a · Cited by 683
Jusup, M., Holme, P., Kanazawa, K., Takayasu, M., Romić, I., Wang, Z., Geček, S., Lipić, T., Podobnik, B., Wang, L., et al. (2022) · Physics Reports · doi:10.1016/j.physrep.2021.10.005 · Cited by 643
Big-Data Science in Porous Materials: Materials Genomics and Machine Learning
Jablonka, K. M., Ongari, D., Moosavi, S. M., & Smit, B. (2020) · Chemical Reviews · doi:10.1021/acs.chemrev.0c00004 · Cited by 599
The Role of Machine Learning in the Understanding and Design of Materials
Moosavi, S. M., Jablonka, K. M., & Smit, B. (2020) · Journal of the American Chemical Society · doi:10.1021/jacs.0c09105 · Cited by 433
Polino, E., Valeri, M., Spagnolo, N., & Sciarrino, F. (2020) · AVS Quantum Science · doi:10.1116/5.0007577 · Cited by 414
Unsupervised Learning Methods for Molecular Simulation Data
Glielmo, A., Husic, B. E., Rodriguez, A., Clementi, C., Noé, F., & Laio, A. (2021) · Chemical Reviews · doi:10.1021/acs.chemrev.0c01195 · Cited by 402
Machine learning for high-entropy alloys: Progress, challenges and opportunities
Liu, X., Zhang, J., & Pei, Z. (2023) · Progress in Materials Science · doi:10.1016/j.pmatsci.2022.101018 · Cited by 397
Digital twin, physics-based model, and machine learning applied to damage detection in structures
Ritto, T. G., & Rochinha, F. A. (2021) · Mechanical Systems and Signal Processing · doi:10.1016/j.ymssp.2021.107614 · Cited by 367
Intelligent metasurfaces: control, communication and computing
Li, L., Zhao, H., Liu, C., Li, L., & Cui, T. J. (2022) · eLight · doi:10.1186/s43593-022-00013-3 · Cited by 347
Weinberg, P., & Bukov, M. (2019) · SciPost Physics · doi:10.21468/scipostphys.7.2.020 · Cited by 333
Self-citationDi Valentino, E., Said, J. L., Riess, A., Pollo, A., Poulin, V., Gómez-Valent, A., Weltman, A., Palmese, A., Huang, C. D., Bruck, C. V. D., et al. (2025) · Physics of the Dark Universe · doi:10.1016/j.dark.2025.101965 · Cited by 319
Keim, N. C., Paulsen, J. D., Zeravcic, Z., Sastry, S., & Nagel, S. R. (2019) · Reviews of Modern Physics · doi:10.1103/revmodphys.91.035002 · Cited by 298
Colloquium : Machine learning in nuclear physics
Boehnlein, A., Diefenthaler, M., Sato, N., Schram, M., Ziegler, V., Fanelli, C., Hjorth-Jensen, M., Horn, T., Kuchera, M. P., Lee, D., et al. (2022) · Reviews of Modern Physics · doi:10.1103/revmodphys.94.031003 · Cited by 257
Quantum Many-Body Dynamics in Two Dimensions with Artificial Neural Networks
Schmitt, M., & Heyl, M. (2020) · Physical Review Letters · doi:10.1103/physrevlett.125.100503 · Cited by 221
Artificial intelligence and machine learning for quantum technologies
Krenn, M., Landgraf, J., Foesel, T., & Marquardt, F. (2023) · Physical Review A · doi:10.1103/physreva.107.010101 · Cited by 162
A matter of time: Using dynamics and theory to uncover mechanisms of transcriptional bursting
Lammers, N. C., Kim, Y. J., Zhao, J., & Garcia, H. G. (2020) · Current Opinion in Cell Biology · doi:10.1016/j.ceb.2020.08.001 · Cited by 99
Memorizing without overfitting: Bias, variance, and interpolation in overparameterized models
Rocks, J. W., & Mehta, P. (2022) · Physical Review Research · doi:10.1103/physrevresearch.4.013201 · Cited by 74
Self-citationCharacterizing the loss landscape of variational quantum circuits
Huembeli, P., & Dauphin, A. (2021) · Quantum Science and Technology · doi:10.1088/2058-9565/abdbc9 · Cited by 71
Optimizing quantum heuristics with meta-learning
Wilson, M., Stromswold, R., Wudarski, F., Hadfield, S., Tubman, N. M., & Rieffel, E. G. (2021) · Quantum Machine Intelligence · doi:10.1007/s42484-020-00022-w · Cited by 79
Protein structure prediction by AlphaFold 2: are attention and symmetries all you need?
Bouatta, N., Sorger, P., & AlQuraishi, M. (2021) · Acta Crystallographica Section D Structural Biology · doi:10.1107/s2059798321007531 · Cited by 69
Classification with Quantum Machine Learning: A Survey
Abohashima, Z., Elhosen, M., Houssein, E. H., & Mohamed, W. M. (2020) · arXiv · doi:10.48550/arxiv.2006.12270 · Cited by 68
Miloshevich, G., Cozian, B., Abry, P., Borgnat, P., & Bouchet, F. (2023) · Physical Review Fluids · doi:10.1103/physrevfluids.8.040501 · Cited by 53
Weirich-Benet, E., Pyrina, M., Jiménez-Esteve, B., Fraenkel, E., Cohen, J., & Domeisen, D. I. V. (2023) · Artificial Intelligence for the Earth Systems · doi:10.1175/aies-d-22-0038.1 · Cited by 33
Efficient representations of binarized health deficit data: the frailty index and beyond
Pridham, G., Rockwood, K., & Rutenberg, A. (2023) · GeroScience · doi:10.1007/s11357-022-00723-z · Cited by 17
DOME: recommendations for supervised machine learning validation in biology
Walsh, I., Fishman, D., Garcia-Gasulla, D., Titma, T., Pollastri, G., ELIXIR Machine Learning Focus Group, Capriotti, E., Casadio, R., Capella-Gutierrez, S., Cirillo, D., et al. (2021) · Nature Methods · doi:10.1038/s41592-021-01205-4 · Cited by 282
Effective theory of collective deep learning
Arola-Fernández, L., & Lacasa, L. (2024) · Physical Review Research · doi:10.1103/physrevresearch.6.l042040 · Cited by 3
Metadata
- Authors
- Mehta, P., Bukov, M., Wang, C.-H., Day, A. G. R., Richardson, C., Fisher, C. K., & Schwab, D. J.
- Venue
- Physics Reports
- Publisher
- Elsevier BV
- Published
- 2019-05
- Volume
- 810
- Pages
- 1-124
- ISSN
- 0370-1573 (ISSN-L)
- OpenAlex
- W2789845225
- Cited by
- 920
- References
- 130
- FWCI
- 49.16
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.