The DOI matches its Crossref record; 87 of the 87 references it cites were found in a registry or an index.
Assessment and Validation of Machine Learning Methods for Predicting Molecular Atomization Energies
Open accessAbstract
The accurate and reliable prediction of properties of molecules typically requires computationally intensive quantum-chemical calculations. Recently, machine learning techniques applied to ab initio calculations have been proposed as an efficient approach for describing the energies of molecules in their given ground-state structure throughout chemical compound space (Rupp et al. Phys. Rev. Lett. 2012, 108, 058301). In this paper we outline a number of established machine learning techniques and investigate the influence of the molecular representation on the methods performance. The best methods achieve prediction errors of 3 kcal/mol for the atomization energies of a wide variety of molecules. Rationales for this performance improvement are given together with pitfalls and challenges when applying machine learning approaches to the prediction of quantum-mechanical observables.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Generalized Gradient Approximation Made Simple
Perdew, J. P., Burke, K., & Ernzerhof, M. (1996) · Physical Review Letters · doi:10.1103/physrevlett.77.3865 · Cited by 215,824
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805
Regression shrinkage and selection via the lasso
Tibshirani, R. (1996) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1996.tb02080.x · Cited by 51,482
The Nature of Statistical Learning Theory
Vapnik, V. N. (1995) · doi:10.1007/978-1-4757-2440-0 · Cited by 39,138
Wu, Y. (1999) · Technometrics · doi:10.1080/00401706.1999.10485951 · Cited by 27,221
The Elements of Statistical Learning
Hastie, T., Friedman, J., & Tibshirani, R. (2001) · Springer Series in Statistics · doi:10.1007/978-0-387-21606-5 · Cited by 24,162
Book Review: Pattern Recognition and Machine Learning
Nasrabadi, N. M. (2007) · Journal of Electronic Imaging · doi:10.1117/1.2819119 · Cited by 22,066
(2012) · Encyclopedia of the Sciences of Learning · doi:10.1007/978-1-4419-1428-6_5195 · Cited by 19,370
A fast learning algorithm for deep belief nets
Hinton, G. E., Osindero, S., & Teh, Y.-W. (2006) · Neural Computation · doi:10.1162/neco.2006.18.7.1527 · Cited by 16,336
Advances in Neural Information Processing Systems 19
(2007) · The MIT Press eBooks · doi:10.52202/085713 · Cited by 15,539
Advances in Neural Information Processing Systems 25
Zhang, Y., Sutton, C. A., Storkey, A., & Zoubin Ghahramani, A. (2012) · Cited by 12,653
Gaussian Processes for Machine Learning
Rasmussen, C. E., & Williams, C. K. I. (2005) · doi:10.7551/mitpress/3206.001.0001 · Cited by 11,705
Learning with Kernels: Support Vector Machines, Regularization, Optimization, and Beyond
Schölkopf, B., & Smola, A. J. (2001) · The MIT Press eBooks · doi:10.7551/mitpress/4175.001.0001 · Cited by 11,703
Mixed-Effects Models in Sand S-PLUS
Pinheiro, J. C., & Bates, D. M. (2000) · Statistics and Computing · doi:10.1007/978-1-4419-0318-1 · Cited by 11,187
Cross validatory choice and assessment of statistical predictions
Stone, M. (1974) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1974.tb00994.x · Cited by 10,881
UFF, a full periodic table force field for molecular mechanics and molecular dynamics simulations
Rappe, A. K., Casewit, C. J., Colwell, K. S., Goddard, W. A., & Skiff, W. M. (1992) · Journal of the American Chemical Society · doi:10.1021/ja00051a040 · Cited by 10,557
Mixed-Effects Models in S and S-PLUS
(2001) · Technometrics · doi:10.1198/tech.2001.s574 · Cited by 9,278
Goodall, C. (1988) · Technometrics · doi:10.1080/00401706.1988.10488412 · Cited by 8,675
Weininger, D. (1988) · Journal of Chemical Information and Computer Sciences · doi:10.1021/ci00057a005 · Cited by 7,436
Learning Deep Architectures for AI
Bengio, Y. (2009) · Foundations and Trends® in Machine Learning · doi:10.1561/2200000006 · Cited by 6,938
Chiang, L. H., Russell, E. L., & Braatz, R. D. (2001) · Advanced Textbooks in Control and Signal Processing · doi:10.1007/978-1-4471-0347-9_4 · Cited by 6,594
Assessment of the Perdew–Burke–Ernzerhof exchange-correlation functional
Ernzerhof, M., & Scuseria, G. E. (1999) · The Journal of Chemical Physics · doi:10.1063/1.478401 · Cited by 5,497
Fast Training of Support Vector Machines Using Sequential Minimal Optimization
Platt, J. C. (1998) · Advances in Kernel Methods · doi:10.7551/mitpress/1130.003.0016 · Cited by 5,437
Generalized Neural-Network Representation of High-Dimensional Potential-Energy Surfaces
Behler, J., & Parrinello, M. (2007) · Physical Review Letters · doi:10.1103/physrevlett.98.146401 · Cited by 5,010
Chiang, L. H., Russell, E. L., & Braatz, R. D. (2001) · Advanced Textbooks in Control and Signal Processing · doi:10.1007/978-1-4471-0347-9_3 · Cited by 5,003
Statistical Modeling: The Two Cultures (with comments and a rejoinder by the author)
Breiman, L. (2001) · Statistical Science · doi:10.1214/ss/1009213726 · Cited by 4,340
An Introduction to Support Vector Machines
Cristianini, N., & Shawe-Taylor, J. S. (2000) · ePrints Soton (University of Southampton) · Cited by 4,115
Stewart, J. J. P. (2007) · Journal of Molecular Modeling · doi:10.1007/s00894-007-0233-4 · Cited by 3,619
An introduction to kernel-based learning algorithms
Muller, K.-R., Mika, S., Ratsch, G., Tsuda, K., & Scholkopf, B. (2001) · IEEE Transactions on Neural Networks · doi:10.1109/72.914517 · Cited by 3,473
Gaussian Approximation Potentials: The Accuracy of Quantum Mechanics, without the Electrons
Bartók, A. P., Payne, M. C., Kondor, R., & Csányi, G. (2010) · Physical Review Letters · doi:10.1103/physrevlett.104.136403 · Cited by 3,242
Ab initio molecular simulations with numeric atom-centered orbitals
Blum, V., Gehrke, R., Hanke, F., Havu, P., Havu, V., Ren, X., Reuter, K., & Scheffler, M. (2009) · Computer Physics Communications · doi:10.1016/j.cpc.2009.06.022 · Cited by 2,919
Self-citationRandom Features for Large-Scale Kernel Machines
Rahimi, A., & Recht, B. (2007) · Cited by 2,783
Hawkins, D. M. (2004) · Journal of Chemical Information and Computer Sciences · doi:10.1021/ci0342472 · Cited by 2,522
Fast and Accurate Modeling of Molecular Atomization Energies with Machine Learning
Rupp, M., Tkatchenko, A., Müller, K.-R., & von Lilienfeld, O. A. (2012) · Physical Review Letters · doi:10.1103/physrevlett.108.058301 · Cited by 2,312
Self-citationThe Nature of Statistical Learning
Vapnik, V. N. (1995) · Medical Entomology and Zoology · Cited by 2,295
Neural Networks: Tricks of the Trade: Second Edition
(2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-35289-8 · Cited by 2,116
Self-citationXVI. Functions of positive and negative type, and their connection the theory of integral equations
Mercer, J. (1909) · Philosophical Transactions of the Royal Society of London. Series A, Containing Papers of a Mathematical or Physical Character · doi:10.1098/rsta.1909.0016 · Cited by 2,001
(2010) · doi:10.5555/1756006.1859921 · Cited by 1,924
LeCun, Y., Bottou, L., Orr, G., & Müller, K. (1998) · neural information processing systems · Cited by 1,333
Self-citationDeep, Big, Simple Neural Nets for Handwritten Digit Recognition
Cireşan, D. C., Meier, U., Gambardella, L. M., & Schmidhuber, J. (2010) · Neural Computation · doi:10.1162/neco_a_00052 · Cited by 1,078
Mixed-Effects Models in S and S-PLUS
(2000) · Statistics and Computing · doi:10.1007/b98882 · Cited by 930
970 Million Druglike Small Molecules for Virtual Screening in the Chemical Universe Database GDB-13
Blum, L. C., & Reymond, J.-L. (2009) · Journal of the American Chemical Society · doi:10.1021/ja902302h · Cited by 860
Neural network potential-energy surfaces in chemistry: a tool for large-scale simulations
Behler, J. (2011) · Physical Chemistry Chemical Physics · doi:10.1039/c1cp21668f · Cited by 781
Burger's Medicinal Chemistry and Drug Discovery
(1997) · European Journal of Medicinal Chemistry · doi:10.1016/s0223-5234(97)84367-x · Cited by 676
Submodel Selection and Evaluation in Regression. The X-Random Case
Breiman, L., & Spector, P. (1992) · International Statistical Review / Revue Internationale de Statistique · doi:10.2307/1403680 · Cited by 669
Finding Density Functionals with Machine Learning
Snyder, J. C., Rupp, M., Hansen, K., Müller, K.-R., & Burke, K. (2012) · Physical Review Letters · doi:10.1103/physrevlett.108.253002 · Cited by 644
Self-citationIntroduction to machine learning for brain imaging
Lemm, S., Blankertz, B., Dickhaus, T., & Müller, K.-R. (2011) · NeuroImage · doi:10.1016/j.neuroimage.2010.11.004 · Cited by 630
Self-citationTraining Invariant Support Vector Machines
Decoste, D., & Schölkopf, B. (2002) · Machine Learning · doi:10.1023/a:1012454411458 · Cited by 588
Stochastic Gradient Learning in Neural Networks
Bottou, L. (1991) · Cited by 584
Hautier, G., Fischer, C. C., Jain, A., Mueller, T., & Ceder, G. (2010) · Chemistry of Materials · doi:10.1021/cm100795d · Cited by 580
(2007) · The MIT Press eBooks · doi:10.7551/mitpress/7496.001.0001 · Cited by 536
Burger's Medicinal Chemistry and Drug Discovery
Abraham, D. J. (2003) · Wiley eBooks · doi:10.1002/0471266949 · Cited by 499
Neural network models of potential energy surfaces
Blank, T. B., Brown, S. D., Calhoun, A. W., & Doren, D. J. (1995) · The Journal of Chemical Physics · doi:10.1063/1.469597 · Cited by 498
Density Ratio Estimation in Machine Learning
Sugiyama, M., Suzuki, T., & Kanamori, T. (2012) · Cambridge University Press eBooks · doi:10.1017/cbo9781139035613 · Cited by 431
Pattern Recognition and Machine Learning, 2006
Bishop, C., & Park, W. (2007) · Cited by 422
Representing high-dimensional potential-energy surfaces for reactions at surfaces by neural networks
Lorenz, S., Groß, A., & Scheffler, M. (2004) · Chemical Physics Letters · doi:10.1016/j.cplett.2004.07.076 · Cited by 397
Self-citationThe Blue Obelisk—Interoperability in Chemical Informatics
Guha, R., Howard, M. T., Hutchison, G. R., Murray-Rust, P., Rzepa, H., Steinbeck, C., Wegner, J., & Willighagen, E. L. (2006) · Journal of Chemical Information and Modeling · doi:10.1021/ci050400b · Cited by 389
Asymptotic statistical theory of overtraining and cross-validation
Amari, S., Murata, N., Muller, K.-R., Finke, M., & Yang, H. H. (1997) · IEEE Transactions on Neural Networks · doi:10.1109/72.623200 · Cited by 351
Potential Energy Surfaces Fitted by Artificial Neural Networks
Handley, C. M., & Popelier, P. L. A. (2010) · The Journal of Physical Chemistry A · doi:10.1021/jp9105585 · Cited by 326
Most likely heteroscedastic Gaussian process regression
Kersting, K., Plagemann, C., Pfaff, P., & Burgard, W. (2007) · Proceedings of the 24th international conference on Machine learning · doi:10.1145/1273496.1273546 · Cited by 311
Dimensionality Reduction and Visualization in Principal Component Analysis
Ivosev, G., Burton, L., & Bonner, R. (2008) · Analytical Chemistry · doi:10.1021/ac800110w · Cited by 286
Manzhos, S., & Carrington, T. (2006) · The Journal of Chemical Physics · doi:10.1063/1.2336223 · Cited by 256
Behler, J., Martoňák, R., Donadio, D., & Parrinello, M. (2008) · Physical Review Letters · doi:10.1103/physrevlett.100.185501 · Cited by 233
Balabin, R. M., & Lomakina, E. I. (2011) · Physical Chemistry Chemical Physics · doi:10.1039/c1cp00051a · Cited by 205
Balabin, R. M., & Lomakina, E. I. (2009) · The Journal of Chemical Physics · doi:10.1063/1.3206326 · Cited by 169
Estimation for High‐Dimensional Linear Mixed‐Effects Models Using ℓ1‐Penalization
SCHELLDORFER, J., Bühlmann, P., & van de Geer, S. (2011) · Scandinavian Journal of Statistics · doi:10.1111/j.1467-9469.2011.00740.x · Cited by 149
Estimation for High-Dimensional Linear Mixed-Effects Models Using ℓ1-PenalizationPreprint
van de Geer, S. (2010) · Cited by 146
Lorenz, S., Scheffler, M., & Groß, A. (2006) · Physical Review B · doi:10.1103/physrevb.73.115431 · Cited by 135
Self-citationConstruction of high-dimensional neural network potentials using environment-dependent atom pairs
Jose, K. V. J., Artrith, N., & Behler, J. (2012) · The Journal of Chemical Physics · doi:10.1063/1.4712397 · Cited by 131
History of Quantitative Structure–Activity Relationships
Selassie, C. R. D., & Verma, R. P. (2010) · Wiley eBooks · doi:10.1002/0471266949.bmc001.pub2 · Cited by 124
Combined first-principles calculation and neural-network correction approach for heat of formation
Hu, L., Wang, X., Wong, L., & Chen, G. (2003) · The Journal of Chemical Physics · doi:10.1063/1.1630951 · Cited by 122
On Relevant Dimensions in Kernel Feature Spaces
Braun, M. L., Buhmann, J. M., & Müller, K. (2008) · doi:10.5555/1390681.1442795 · Cited by 113
Self-citationOptimizing transition states via kernel-based machine learning
Pozun, Z. D., Hansen, K., Sheppard, D., Rupp, M., Müller, K., & Henkelman, G. (2012) · The Journal of Chemical Physics · doi:10.1063/1.4707167 · Cited by 111
Self-citationKernel analysis of deep networks
Montavon, G., Braun, M. L., & Müller, K. (2011) · Cited by 97
Self-citationLearning Invariant Representations of Molecules for Atomization Energy Prediction
Montavon, G., Hansen, K., Fazli, S., Biegler, F., Ziehe, A., Tkatchenko, A., von Lilienfeld, O. A., & Müller, K.-R. (2014) · Cited by 97
Self-citationPotential energy surfaces for macromolecules. A neural network technique
Sumpter, B. G., & Noid, D. W. (1992) · Chemical Physics Letters · doi:10.1016/0009-2614(92)85498-y · Cited by 94
Classifying ‘Drug-likeness' with Kernel-Based Learning Methods
Müller, K., Rätsch, G., Sonnenburg, S., Mika, S., Grimm, M., & Heinrich, N. (2005) · Journal of Chemical Information and Modeling · doi:10.1021/ci049737o · Cited by 85
Self-citationDynamically Polarizable Water Potential Based on Multipole Moments Trained by Machine Learning
Handley, C. M., & Popelier, P. L. A. (2009) · Journal of Chemical Theory and Computation · doi:10.1021/ct800468h · Cited by 71
A Numerical Study on Learning Curves in Stochastic Multilayer Feedforward Networks
Müller, K. R., Finke, M., Murata, N., Schulten, K., & Амари, Ш.-И. (1996) · Neural Computation · doi:10.1162/neco.1996.8.5.1085 · Cited by 70
Self-citationA generalized exchange-correlation functional: the Neural-Networks approach
Zheng, X. H., Hu, L., Wang, X., & Chen, G. (2004) · Chemical Physics Letters · doi:10.1016/j.cplett.2004.04.020 · Cited by 65
Intramolecular polarisable multipolar electrostatics from the machine learning method Kriging
Mills, M. J. L., & Popelier, P. L. A. (2011) · Computational and Theoretical Chemistry · doi:10.1016/j.comptc.2011.04.004 · Cited by 58
ℓ1-penalized linear mixed-effects models for high dimensional data with application to BCI
Fazli, S., Danóczy, M., Schelldorfer, J., & Müller, K. (2011) · NeuroImage · doi:10.1016/j.neuroimage.2011.03.061 · Cited by 49
Self-citationComment on “Fast and Accurate Modeling of Molecular Atomization Energies with Machine Learning”
Moussa, J. E. (2012) · Physical Review Letters · doi:10.1103/physrevlett.109.059801 · Cited by 45
Montavon, G., Braun, M. L., Krueger, T., & Müller, K. (2013) · IEEE Signal Processing Magazine · doi:10.1109/msp.2013.2249294 · Cited by 43
Self-citationBias-Correction of Regression Models: A Case Study on hERG Inhibition
Hansen, K., Rathke, F., Schroeter, T. S., Rast, G. F., Fox, T., Kriegl, J. M., & Mika, S. (2009) · Journal of Chemical Information and Modeling · doi:10.1021/ci9000794 · Cited by 27
Self-citationRupp, M., Tkatchenko, A., Müller, K.-R., & von Lilienfeld, O. A. (2012) · Physical Review Letters · doi:10.1103/physrevlett.109.059802 · Cited by 23
Self-citationA review of quantitative structure-activity relationship (QSAR) models
Tilleghem, C. L. B. D., & Govaerts, B. B. (2007) · Cited by 4
Cited by
SchNet – A deep learning architecture for molecules and materials
Schütt, K. T., Sauceda, H. E., Kindermans, P.-J., Tkatchenko, A., & Müller, K.-R. (2018) · The Journal of Chemical Physics · doi:10.1063/1.5019779 · Cited by 2,217
Self-citationUnke, O. T., Chmiela, S., Sauceda, H. E., Gastegger, M., Poltavsky, I., Schütt, K. T., Tkatchenko, A., & Müller, K.-R. (2021) · Chemical Reviews · doi:10.1021/acs.chemrev.0c01111 · Cited by 1,647
Self-citationQuantum-chemical insights from deep tensor neural networks
Schütt, K. T., Arbabzadah, F., Chmiela, S., Müller, K. R., & Tkatchenko, A. (2017) · Nature Communications · doi:10.1038/ncomms13890 · Cited by 1,445
Self-citationMaterials discovery and design using machine learning
Liu, Y., Zhao, T., Ju, W., & Shi, S. (2017) · Journal of Materiomics · doi:10.1016/j.jmat.2017.08.002 · Cited by 1,276
Machine learning in materials science
Wei, J., Chu, X., Sun, X., Xu, K., Deng, H., Chen, J., Wei, Z., & Lei, M. (2019) · InfoMat · doi:10.1002/inf2.12028 · Cited by 1,069
Metadata
- Authors
- Hansen, K., Montavon, G., Biegler, F., Fazli, S., Rupp, M., Scheffler, M., von Lilienfeld, O. A., Tkatchenko, A., & Müller, K.-R.
- Venue
- Journal of Chemical Theory and Computation
- Publisher
- American Chemical Society (ACS)
- Published
- 2013-07-30
- Volume
- 9
- Issue
- 8
- Pages
- 3404-3419
- ISSN
- 1549-9618 (ISSN-L)
- 1549-9626
- OpenAlex
- W1998260904
- Cited by
- 613
- References
- 87
- FWCI
- 8.73
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
