A Density Functional Tight Binding Layer for Deep Learning of Chemical Hamiltonians
Open accessThe DOI matches its Crossref record; 11 of the 11 references it cites were found in a registry or an index.
Abstract
Current neural networks for predictions of molecular properties use quantum chemistry only as a source of training data. This paper explores models that use quantum chemistry as an integral part of the prediction process. This is done by implementing self-consistent-charge Density-Functional-Tight-Binding (DFTB) theory as a layer for use in deep learning models. The DFTB layer takes, as input, Hamiltonian matrix elements generated from earlier layers and produces, as output, electronic properties from self-consistent field solutions of the corresponding DFTB Hamiltonian. Backpropagation enables efficient training of the model to target electronic properties. Two types of input to the DFTB layer are explored, splines and feed-forward neural networks. Because overfitting can cause models trained on smaller molecules to perform poorly on larger molecules, regularizations are applied that penalize nonmonotonic behavior and deviation of the Hamiltonian matrix elements from those of the published DFTB model used to initialize the model. The approach is evaluated on 15 700 hydrocarbons by comparing the root-mean-square error in energy and dipole moment, on test molecules with eight heavy atoms, to the error from the initial DFTB model. When trained on molecules with up to seven heavy atoms, the spline model reduces the test error in energy by 60% and in dipole moments by 42%. The neural network model performs somewhat better, with error reductions of 67% and 59%, respectively. Training on molecules with up to four heavy atoms reduces performance, with both the spline and neural net models reducing the test error in energy by about 53% and in dipole by about 25%.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Ren, S., He, K., Girshick, R., & Sun, J. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2577031 · Cited by 73,472
Generalized Neural-Network Representation of High-Dimensional Potential-Energy Surfaces
Behler, J., & Parrinello, M. (2007) · Physical Review Letters · doi:10.1103/physrevlett.98.146401 · Cited by 5,010
Fast and Accurate Modeling of Molecular Atomization Energies with Machine Learning
Rupp, M., Tkatchenko, A., Müller, K.-R., & von Lilienfeld, O. A. (2012) · Physical Review Letters · doi:10.1103/physrevlett.108.058301 · Cited by 2,312 · cited 1×
“9 The ML models explored to date use, as input, either features derived solely from the structure of the molecular system, 6,9–15 or, in the case of ∆-machine-learning models, 16–19 a combination of structural features and re-sults from lower-cost quantum chemical meth-ods.”
MethodANI-1: an extensible neural network potential with DFT accuracy at force field computational cost
Smith, J. S., Isayev, O., & Roitberg, A. E. (2017) · Chemical Science · doi:10.1039/c6sc05720a · Cited by 1,921 · cited 2×
“The ANI-1 potential 21 is a neural network that achieves high accuracy on the entire ANI-1 data set.”
BackgroundMethodEnumeration of 166 Billion Organic Small Molecules in the Chemical Universe Database GDB-17
Ruddigkeit, L., van Deursen, R., Blum, L. C., & Reymond, J.-L. (2012) · Journal of Chemical Information and Modeling · doi:10.1021/ci300415d · Cited by 1,505
Quantum-chemical insights from deep tensor neural networks
Schütt, K. T., Arbabzadah, F., Chmiela, S., Müller, K. R., & Tkatchenko, A. (2017) · Nature Communications · doi:10.1038/ncomms13890 · Cited by 1,445
Big Data of Materials Science: Critical Role of the Descriptor
Ghiringhelli, L. M., Vybiral, J., Levchenko, S. V., Draxl, C., & Scheffler, M. (2015) · Physical Review Letters · doi:10.1103/physrevlett.114.105503 · Cited by 920
Big Data Meets Quantum Chemistry Approximations: The Δ-Machine Learning Approach
Ramakrishnan, R., Dral, P. O., Rupp, M., & von Lilienfeld, O. A. (2015) · Journal of Chemical Theory and Computation · doi:10.1021/acs.jctc.5b00099 · Cited by 911
Constructing high‐dimensional neural network potentials: A tutorial review
Behler, J. (2015) · International Journal of Quantum Chemistry · doi:10.1002/qua.24890 · Cited by 884
Intrinsic Bond Energies from a Bonds-in-Molecules Neural Network
Yao, K., Herr, J. E., Brown, S. N., & Parkhill, J. (2017) · The Journal of Physical Chemistry Letters · doi:10.1021/acs.jpclett.7b01072 · Cited by 126
Generalized Density-Functional Tight-Binding Repulsive Potentials from Unsupervised Machine Learning
Kranz, J. J., Kubillus, M., Ramakrishnan, R., von Lilienfeld, O. A., & Elstner, M. (2018) · Journal of Chemical Theory and Computation · doi:10.1021/acs.jctc.7b00933 · Cited by 63
Cited by
Unke, O. T., Chmiela, S., Sauceda, H. E., Gastegger, M., Poltavsky, I., Schütt, K. T., Tkatchenko, A., & Müller, K.-R. (2021) · Chemical Reviews · doi:10.1021/acs.chemrev.0c01111 · Cited by 1,647
Hourahine, B., Aradi, B., Blum, V., Bonafé, F., Buccheri, A., Camacho, C., Cevallos, C., Deshaye, M. Y., Dumitrică, T., Dominguez, A., et al. (2020) · The Journal of Chemical Physics · doi:10.1063/1.5143190 · Cited by 1,180
From DFT to machine learning: recent approaches to materials science–a review
Schleder, G. R., Padilha, A. C. M., Acosta, C. M., Costa, M., & Fazzio, A. (2019) · Journal of Physics: Materials · doi:10.1088/2515-7639/ab084b · Cited by 852
Combining Machine Learning and Computational Chemistry for Predictive Insights Into Chemical Systems
Keith, J. A., Vassilev-Galindo, V., Cheng, B., Chmiela, S., Gastegger, M., Müller, K.-R., & Tkatchenko, A. (2021) · Chemical Reviews · doi:10.1021/acs.chemrev.1c00107 · Cited by 849
Schütt, K. T., Gastegger, M., Tkatchenko, A., Müller, K.-R., & Maurer, R. J. (2019) · Nature Communications · doi:10.1038/s41467-019-12875-2 · Cited by 476
Metadata
- Authors
- Li, H., Collins, C., Tanha, M., Gordon, G. J., & Yaron, D. J.
- Venue
- Journal of Chemical Theory and Computation
- Publisher
- American Chemical Society (ACS)
- Published
- 2018-10-15
- Volume
- 14
- Issue
- 11
- Pages
- 5764-5776
- ISSN
- 1549-9618 (ISSN-L)
- 1549-9626
- OpenAlex
- W2885190592
- Cited by
- 115
- References
- 11
- FWCI
- 4.79
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.