Intrinsic Bond Energies from a Bonds-in-Molecules Neural Network
Abstract
Neural networks are being used to make new types of empirical chemical models as inexpensive as force fields, but with accuracy similar to the ab initio methods used to build them. In this work, we present a neural network that predicts the energies of molecules as a sum of intrinsic bond energies. The network learns the total energies of the popular GDB9 database to a competitive MAE of 0.94 kcal/mol on molecules outside of its training set, is naturally linearly scaling, and applicable to molecules consisting of thousands of bonds. More importantly, it gives chemical insight into the relative strengths of bonds as a function of their molecular environment, despite only being trained on total energy information. We show that the network makes predictions of relative bond strengths in good agreement with measured trends and human predictions. A Bonds-in-Molecules Neural Network (BIM-NN) learns heuristic relative bond strengths like expert synthetic chemists, and compares well with ab initio bond order measures such as NBO analysis.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Cites
Learning representations by back-propagating errors
Rumelhart, D. E., Hinton, G. E., & Williams, R. J. (1986) · Nature · doi:10.1038/323533a0 · Cited by 31,892 · see citing works
Reed, A. E., Weinstock, R. B., & Weinhold, F. (1985) · The Journal of Chemical Physics · doi:10.1063/1.449486 · Cited by 9,966 · see citing works
Nucleus-Independent Chemical Shifts: A Simple and Efficient Aromaticity Probe
Schleyer, P. V. R., Maerker, C., Dransfeld, A., Jiao, H., & van Eikema Hommes, N. J. R. (1996) · Journal of the American Chemical Society · doi:10.1021/ja960582d · Cited by 6,210 · see citing works
Generalized Neural-Network Representation of High-Dimensional Potential-Energy Surfaces
Behler, J., & Parrinello, M. (2007) · Physical Review Letters · doi:10.1103/physrevlett.98.146401 · Cited by 5,010 · see citing works
Foster, J. P., & Weinhold, F. (1980) · Journal of the American Chemical Society · doi:10.1021/ja00544a007 · Cited by 5,007 · see citing works
Gaussian Approximation Potentials: The Accuracy of Quantum Mechanics, without the Electrons
Bartók, A. P., Payne, M. C., Kondor, R., & Cśanyi, G. (2010) · Physical Review Letters · doi:10.1103/physrevlett.104.136403 · Cited by 3,144 · see citing works
On representing chemical environments
Bartók, A. P., Kondor, R., & Csányi, G. (2013) · Physical Review B · doi:10.1103/physrevb.87.184115 · Cited by 2,572 · see citing works
Fast and Accurate Modeling of Molecular Atomization Energies with Machine Learning
Rupp, M., Tkatchenko, A., Müller, K.-R., & von Lilienfeld, O. A. (2012) · Physical Review Letters · doi:10.1103/physrevlett.108.058301 · Cited by 2,312 · see citing works
Hydrocarbon Bond Dissociation Energies
McMillen, D. F., & Golden, D. M. (1982) · Annual Review of Physical Chemistry · doi:10.1146/annurev.pc.33.100182.002425 · Cited by 2,009 · see citing works
Quantum chemistry structures and properties of 134 kilo molecules
Ramakrishnan, R., Dral, P. O., Rupp, M., & von Lilienfeld, O. A. (2014) · Scientific Data · doi:10.1038/sdata.2014.22 · Cited by 1,966 · see citing works
ANI-1: an extensible neural network potential with DFT accuracy at force field computational cost
Smith, J. S., Isayev, O., & Roitberg, A. E. (2017) · Chemical Science · doi:10.1039/c6sc05720a · Cited by 1,921 · see citing works
(2005) · Choice Reviews Online · doi:10.5860/choice.42-5612 · Cited by 1,864 · see citing works
Molecular graph convolutions: moving beyond fingerprints
Kearnes, S., McCloskey, K., Berndl, M., Pande, V., & Riley, P. (2016) · Journal of Computer-Aided Molecular Design · doi:10.1007/s10822-016-9938-8 · Cited by 1,631 · see citing works
Atom-centered symmetry functions for constructing high-dimensional neural network potentials
Behler, J. (2011) · The Journal of Chemical Physics · doi:10.1063/1.3553717 · Cited by 1,621 · see citing works
Accurate and Efficient Method for Many-Body van der Waals Interactions
Tkatchenko, A., DiStasio, R. A., Car, R., & Scheffler, M. (2012) · Physical Review Letters · doi:10.1103/physrevlett.108.236402 · Cited by 1,528 · see citing works
Enumeration of 166 Billion Organic Small Molecules in the Chemical Universe Database GDB-17
Ruddigkeit, L., van Deursen, R., Blum, L. C., & Reymond, J.-L. (2012) · Journal of Chemical Information and Modeling · doi:10.1021/ci300415d · Cited by 1,505 · see citing works
Quantum-chemical insights from deep tensor neural networks
Schütt, K. T., Arbabzadah, F., Chmiela, S., Müller, K. R., & Tkatchenko, A. (2017) · Nature Communications · doi:10.1038/ncomms13890 · Cited by 1,445 · see citing works
Machine learning of accurate energy-conserving molecular force fields
Chmiela, S., Tkatchenko, A., Sauceda, H. E., Poltavsky, I., Schütt, K. T., & Müller, K. (2017) · Science Advances · doi:10.1126/sciadv.1603015 · Cited by 1,165 · see citing works
Accelerating materials property predictions using machine learning
Pilania, G., Wang, C., Jiang, X., Rajasekaran, S., & Ramprasad, R. (2013) · Scientific Reports · doi:10.1038/srep02810 · Cited by 851 · see citing works
Hansen, K., Biegler, F., Ramakrishnan, R., Pronobis, W., von Lilienfeld, O. A., Müller, K.-R., & Tkatchenko, A. (2015) · The Journal of Physical Chemistry Letters · doi:10.1021/acs.jpclett.5b00831 · Cited by 815 · see citing works
Weinhold, F. (2012) · Journal of Computational Chemistry · doi:10.1002/jcc.23060 · Cited by 782 · see citing works
Neural network potential-energy surfaces in chemistry: a tool for large-scale simulations
Behler, J. (2011) · Physical Chemistry Chemical Physics · doi:10.1039/c1cp21668f · Cited by 781 · see citing works
Machine learning based interatomic potential for amorphous carbon
Deringer, V. L., & Cśanyi, G. (2017) · Physical review. B./Physical review. B · doi:10.1103/physrevb.95.094203 · Cited by 665 · see citing works
Hachmann, J., Olivares‐Amaya, R., Atahan-Evrenk, Ş., Amador‐Bedolla, C., Sánchez‐Carrera, R. S., Gold‐Parker, A., Vogt-Maranto, L., Brockway, A. M., & Aspuru‐Guzik, A. (2011) · The Journal of Physical Chemistry Letters · doi:10.1021/jz200866s · Cited by 647 · see citing works
Finding Density Functionals with Machine Learning
Snyder, J. C., Rupp, M., Hansen, K., Müller, K., & Burke, K. (2012) · Physical Review Letters · doi:10.1103/physrevlett.108.253002 · Cited by 635 · see citing works
Machine learning of molecular electronic properties in chemical compound space
Montavon, G., Rupp, M., Gobre, V., Vazquez-Mayagoitia, A., Hansen, K., Tkatchenko, A., Müller, K.-R., & von Lilienfeld, O. A. (2013) · New Journal of Physics · doi:10.1088/1367-2630/15/9/095003 · Cited by 631 · see citing works
Assessment and Validation of Machine Learning Methods for Predicting Molecular Atomization Energies
Hansen, K., Montavon, G., Biegler, F., Fazli, S., Rupp, M., Scheffler, M., von Lilienfeld, O. A., Tkatchenko, A., & Müller, K. (2013) · Journal of Chemical Theory and Computation · doi:10.1021/ct400195d · Cited by 615 · see citing works
Hautier, G., Fischer, C. C., Jain, A., Mueller, T., & Ceder, G. (2010) · Chemistry of Materials · doi:10.1021/cm100795d · Cited by 580 · see citing works
Permutation invariant polynomial neural network approach to fitting potential energy surfaces
Jiang, B., & Guo, H. (2013) · The Journal of Chemical Physics · doi:10.1063/1.4817187 · Cited by 542 · see citing works
How van der Waals interactions determine the unique properties of water
Morawietz, T., Singraber, A., Dellago, C., & Behler, J. (2016) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1602375113 · Cited by 487 · see citing works
Schütt, K. T., Glawe, H., Brockherde, F., Sanna, A., Müller, K. R., & Gross, E. K. U. (2014) · Physical Review B · doi:10.1103/physrevb.89.205118 · Cited by 460 · see citing works
Machine-Learning-Augmented Chemisorption Model for CO2 Electroreduction Catalyst Screening
Ma, X., Li, Z., Achenie, L. E. K., & Xin, H. (2015) · The Journal of Physical Chemistry Letters · doi:10.1021/acs.jpclett.5b01660 · Cited by 422 · see citing works
Machine learning of molecular electronic properties in chemical compound space
Montavon, G., Rupp, M., Gobre, V. V., Vázquez‐Mayagoitia, Á., Hansen, K., Tkatchenko, A., Müller, K., & von Lilienfeld, O. A. (2013) · MPG.PuRe (Max Planck Society) · doi:10.3929/ethz-b-000071765 · Cited by 414 · see citing works
A Simple, Exact Density-Functional-Theory Embedding Scheme
Manby, F. R., Stella, M., Goodpaster, J. D., & Miller, T. F. (2012) · Journal of Chemical Theory and Computation · doi:10.1021/ct300544e · Cited by 393 · see citing works
Nucleation mechanism for the direct graphite-to-diamond phase transition
Khaliullin, R. Z., Eshet, H., Kühne, T. D., Behler, J., & Parrinello, M. (2011) · Nature Materials · doi:10.1038/nmat3078 · Cited by 370 · see citing works
Potential Energy Surfaces Fitted by Artificial Neural Networks
Handley, C. M., & Popelier, P. L. A. (2010) · The Journal of Physical Chemistry A · doi:10.1021/jp9105585 · Cited by 328 · see citing works
Isayev, O., Fourches, D., Muratov, E. N., Oses, C., Rasch, K., Tropsha, A., & Curtarolo, S. (2015) · Chemistry of Materials · doi:10.1021/cm503507h · Cited by 300 · see citing works
Virshup, A. M., Contreras-García, J., Wipf, P., Yang, W., & Beratan, D. N. (2013) · Journal of the American Chemical Society · doi:10.1021/ja401184g · Cited by 294 · see citing works
Huang, B., & von Lilienfeld, O. A. (2016) · The Journal of Chemical Physics · doi:10.1063/1.4964627 · Cited by 294 · see citing works
Ghasemi, S. A., Hofstetter, A., Saha, S., & Goedecker, S. (2015) · Physical Review B · doi:10.1103/physrevb.92.045131 · Cited by 293 · see citing works
Communication: Fitting potential energy surfaces with fundamental invariant neural network
Shao, K., Chen, J., Zhao, Z., & Zhang, D. H. (2016) · The Journal of Chemical Physics · doi:10.1063/1.4961454 · Cited by 260 · see citing works
Manzhos, S., & Carrington, T. (2006) · The Journal of Chemical Physics · doi:10.1063/1.2336223 · Cited by 257 · see citing works
Hachmann, J., Olivares‐Amaya, R., Jinich, A., Appleton, A. L., Blood-Forsythe, M. A., Seress, L. R., Román-Salgado, C., Trepte, K., Atahan-Evrenk, Ş., Er, S., et al. (2013) · Energy & Environmental Science · doi:10.1039/c3ee42756k · Cited by 247 · see citing works
Olivares‐Amaya, R., Amador‐Bedolla, C., Hachmann, J., Atahan-Evrenk, Ş., Sánchez‐Carrera, R. S., Vogt-Maranto, L., & Aspuru‐Guzik, A. (2011) · Energy & Environmental Science · doi:10.1039/c1ee02056k · Cited by 204 · see citing works
Manzhos, S., Dawes, R., & Carrington, T. (2014) · International Journal of Quantum Chemistry · doi:10.1002/qua.24795 · Cited by 204 · see citing works
Diatomics-in-molecules potential energy surfaces. I. First-row triatomic hydrides
Tully, J. C. (1973) · The Journal of Chemical Physics · doi:10.1063/1.1679372 · Cited by 189 · see citing works
Diatomics-in-molecules potential energy surfaces. II. Nonadiabatic and spin-orbit interactions
Tully, J. C. (1973) · The Journal of Chemical Physics · doi:10.1063/1.1680731 · Cited by 166 · see citing works
Shakouri, K., Behler, J., Meyer, J., & Kroes, G. (2017) · The Journal of Physical Chemistry Letters · doi:10.1021/acs.jpclett.7b00784 · Cited by 150 · see citing works
A Critical Assessment of Two-Body and Three-Body Interactions in Water
Medders, G. R., Babin, V., & Paesani, F. (2013) · Journal of Chemical Theory and Computation · doi:10.1021/ct300913g · Cited by 145 · see citing works
Chemical Bonding and Aromaticity in Furan, Pyrrole, and Thiophene: A Magnetic Shielding Study
Horner, K. E., & Karadakov, P. B. (2013) · The Journal of Organic Chemistry · doi:10.1021/jo401319k · Cited by 142 · see citing works
Orbital-free bond breaking via machine learning
Snyder, J. C., Rupp, M., Hansen, K., Blooston, L., Müller, K., & Burke, K. (2013) · The Journal of Chemical Physics · doi:10.1063/1.4834075 · Cited by 138 · see citing works
Kinetic Energy of Hydrocarbons as a Function of Electron Density and Convolutional Neural Networks
Yao, K., & Parkhill, J. (2016) · Journal of Chemical Theory and Computation · doi:10.1021/acs.jctc.5b01011 · Cited by 130 · see citing works
Self-citationThe many-body expansion combined with neural networks
Yao, K., Herr, J. E., & Parkhill, J. (2017) · The Journal of Chemical Physics · doi:10.1063/1.4973380 · Cited by 120 · see citing works
Self-citationKolb, B., Lentz, L. C., & Kolpak, A. M. (2017) · Scientific Reports · doi:10.1038/s41598-017-01251-z · Cited by 110 · see citing works
Neural network studies. 1. Estimation of the aqueous solubility of organic compounds
Bodor, N. S., Harget, A. J., & Huang, M. J. (1991) · Journal of the American Chemical Society · doi:10.1021/ja00025a009 · Cited by 108 · see citing works
On the representation of many-body interactions in water
Medders, G. R., Götz, A. W., Morales, M. A., Bajaj, P., & Paesani, F. (2015) · The Journal of Chemical Physics · doi:10.1063/1.4930194 · Cited by 106 · see citing works
Kolb, B., Luo, X., Zhou, X., Jiang, B., & Guo, H. (2017) · The Journal of Physical Chemistry Letters · doi:10.1021/acs.jpclett.6b02994 · Cited by 106 · see citing works
Tian, Y., Yan, X., Saha, M. L., et al. (2016) · Journal of the American Chemical Society · doi:10.1021/jacs.6b07402 · Cited by 105 · see citing works
Nonadiabatic excited-state molecular dynamics: Numerical tests of convergence and parameters
Nelson, T., Fernández-Alberti, S., Chernyak, V., et al. (2012) · The Journal of Chemical Physics · doi:10.1063/1.3680565 · Cited by 96 · see citing works
Exploration, Sampling, And Reconstruction of Free Energy Surfaces with Gaussian Process Regression
Mones, L., Bernstein, N., & Csányi, G. (2016) · Journal of Chemical Theory and Computation · doi:10.1021/acs.jctc.6b00553 · Cited by 91 · see citing works
Simon, V., Gasteiger, J., & Zupan, J. (1993) · Journal of the American Chemical Society · doi:10.1021/ja00073a034 · Cited by 85 · see citing works
Strategy To Discover Diverse Optimal Molecules in the Small Molecule Universe
Rupakheti, C., Virshup, A. M., Yang, W., & Beratan, D. N. (2015) · Journal of Chemical Information and Modeling · doi:10.1021/ci500749q · Cited by 83 · see citing works
Li, J., Chen, J., Zhao, Z., Xie, D., Zhang, D. H., & Guo, H. (2015) · The Journal of Chemical Physics · doi:10.1063/1.4921412 · Cited by 77 · see citing works
A big data approach to the ultra-fast prediction of DFT-calculated bond energies
Qu, X., Latino, D. A. R. S., & Aires‐de‐Sousa, J. (2013) · Journal of Cheminformatics · doi:10.1186/1758-2946-5-34 · Cited by 77 · see citing works
Modeling electronic quantum transport with machine learning
López‐Bezanilla, A., & von Lilienfeld, O. A. (2014) · Physical Review B · doi:10.1103/physrevb.89.235411 · Cited by 73 · see citing works
Chen, L., & Gasteiger, J. (1997) · Journal of the American Chemical Society · doi:10.1021/ja960027b · Cited by 71 · see citing works
Conte, R., Qu, C., & Bowman, J. M. (2015) · Journal of Chemical Theory and Computation · doi:10.1021/acs.jctc.5b00091 · Cited by 71 · see citing works
Cuny, J., Xie, Y., Pickard, C. J., & Hassanali, A. A. (2016) · Journal of Chemical Theory and Computation · doi:10.1021/acs.jctc.5b01006 · Cited by 66 · see citing works
Gastegger, M., Kauffmann, C., Behler, J., & Marquetand, P. (2016) · The Journal of Chemical Physics · doi:10.1063/1.4950815 · Cited by 63 · see citing works
Fitting sparse multidimensional data with low-dimensional terms
Manzhos, S., Yamashita, K., & Carrington, T. (2009) · Computer Physics Communications · doi:10.1016/j.cpc.2009.05.022 · Cited by 57 · see citing works
Zhang, Z., & Zhang, D. H. (2014) · The Journal of Chemical Physics · doi:10.1063/1.4897308 · Cited by 56 · see citing works
Li, J., & Guo, H. (2015) · The Journal of Chemical Physics · doi:10.1063/1.4936660 · Cited by 27 · see citing works
Neural network classification of inductive and resonance effects of substituents
Kvasnička, V., Sklenák, Š., & Pospı́chal, J. (1993) · Journal of the American Chemical Society · doi:10.1021/ja00057a039 · Cited by 19 · see citing works
Molecular Engineering of Torsional Potentials in Fluorogenic Dyes via Electronic Substituent Effects
Ediz, V., Lee, J. L., Armitage, B. A., & Yaron, D. (2008) · The Journal of Physical Chemistry A · doi:10.1021/jp805546s · Cited by 14 · see citing works
Constant Size Molecular Descriptors For Use With Machine LearningPreprint
Collins, C. R., Gordon, G. J., von Lilienfeld, O. A., & Yaron, D. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1701.06649 · Cited by 12 · see citing works
Malshe, M., Raff, L. M., Hagan, M., et al. (2010) · The Journal of Chemical Physics · doi:10.1063/1.3431624 · Cited by 7 · see citing works
Using Molecular Similarity to Develop Reliable Models of Chemical Reactions in Complex Environments
Ediz, V., Monda, A. C., Brown, R. P., & Yaron, D. (2009) · Journal of Chemical Theory and Computation · doi:10.1021/ct9004195 · Cited by 6 · see citing works
Localized Coulomb Descriptors for the Gaussian Approximation PotentialPreprint
Barker, J., Bulin, J., Hamaekers, J., et al. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.05126 · Cited by 5 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Muratov, E. N., Bajorath, J., Sheridan, R. P., Tetko, I. V., Filimonov, D., Poroikov, V., Oprea, T. I., Baskin, I. I., Varnek, A., Roitberg, A., et al. (2020) · Chemical Society Reviews · doi:10.1039/d0cs00098a · Cited by 913 · see citing works
Mater, A. C., & Coote, M. L. (2019) · Journal of Chemical Information and Modeling · doi:10.1021/acs.jcim.9b00266 · Cited by 565 · see citing works
Machine learning molecular dynamics for the simulation of infrared spectra
Gastegger, M., Behler, J., & Marquetand, P. (2017) · Chemical Science · doi:10.1039/c7sc02267k · Cited by 556 · see citing works
Janet, J. P., & Kulik, H. J. (2017) · The Journal of Physical Chemistry A · doi:10.1021/acs.jpca.7b08750 · Cited by 289 · see citing works
A quantitative uncertainty metric controls error in neural network-driven chemical discovery
Janet, J. P., Duan, C., Yang, T., Nandy, A., & Kulik, H. J. (2019) · Chemical Science · doi:10.1039/c9sc02298h · Cited by 243 · see citing works
Janet, J. P., Chan, L., & Kulik, H. J. (2018) · The Journal of Physical Chemistry Letters · doi:10.1021/acs.jpclett.8b00170 · Cited by 200 · see citing works
Machine Learning Protocol for Surface-Enhanced Raman Spectroscopy
Hu, W., Ye, S., Zhang, Y., Li, T., Zhang, G., Luo, Y., Mukamel, S., & Jiang, J. (2019) · The Journal of Physical Chemistry Letters · doi:10.1021/acs.jpclett.9b02517 · Cited by 92 · see citing works
Enumeration of <i>de novo</i> inorganic complexes for chemical discovery and machine learning
Gugler, S., Janet, J. P., & Kulik, H. J. (2020) · Molecular Systems Design & Engineering · doi:10.1039/c9me00069k · Cited by 43 · see citing works
- Authors
- Yao, K., Herr, J. E., Brown, S. N., & Parkhill, J.
- Affiliations
- University of Notre Dame (US)
- Corresponding author
- Parkhill, John
- Venue
- The Journal of Physical Chemistry Letters
- Publisher
- American Chemical Society (ACS)
- Published
- 2017-06-05
- Volume
- 8
- Issue
- 12
- Pages
- 2689-2694
- ISSN
- 1948-7185 (ISSN-L)
- OpenAlex
- W2620906374
- Cited by
- 126
- References
- 78
- Citations by year
- 2025: 8 · 2024: 12 · 2023: 13 · 2022: 11 · 2021: 15 · 2020: 17 · 2019: 21 · 2018: 24 · 2017: 5
- FWCI
- 7.74
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- The Journal of Physical Chemistry Letters (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Physical Sciences › Materials Science › Materials Chemistry › Machine Learning in Materials Science
- Physical Sciences › Physics and Astronomy › Atomic and Molecular Physics, and Optics › Advanced Chemical Physics Studies
- Physical Sciences › Computer Science › Computational Theory and Mathematics › Computational Drug Discovery Methods
- Keywords
- bond order analysis
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review