Putting Density Functional Theory to the Test in Machine-Learning-Accelerated Materials Discovery
Open accessThe DOI matches its Crossref record; 25 of the 25 references it cites were found in a registry or an index.
Abstract
Accelerated discovery with machine learning (ML) has begun to provide the advances in efficiency needed to overcome the combinatorial challenge of computational materials design. Nevertheless, ML-accelerated discovery both inherits the biases of training data derived from density functional theory (DFT) and leads to many attempted calculations that are doomed to fail. Many compelling functional materials and catalytic processes involve strained chemical bonds, open-shell radicals and diradicals, or metal-organic bonds to open-shell transition-metal centers. Although promising targets, these materials present unique challenges for electronic structure methods and combinatorial challenges for their discovery. In this Perspective, we describe the advances needed in accuracy, efficiency, and approach beyond what is typical in conventional DFT-based ML workflows. These challenges have begun to be addressed through ML models trained to predict the results of multiple methods or the differences between them, enabling quantitative sensitivity analysis. For DFT to be trusted for a given data point in a high-throughput screen, it must pass a series of tests. ML models that predict the likelihood of calculation success and detect the presence of strong correlation will enable rapid diagnoses and adaptation strategies. These "decision engines" represent the first steps toward autonomous workflows that avoid the need for expert determination of the robustness of DFT-based materials discoveries.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Grad-CAM: Visual Explanations from Deep Networks via Gradient-Based Localization
Selvaraju, R. R., Cogswell, M., Das, A., Vedantam, R., Parikh, D., & Batra, D. (2020) · International Journal of Computer Vision · doi:10.1007/s11263-019-01228-7 · Cited by 6,909
Machine learning for molecular and materials science
Butler, K. T., Davies, D. W., Cartwright, H., Isayev, O., & Walsh, A. (2018) · Nature · doi:10.1038/s41586-018-0337-2 · Cited by 4,968
The high-throughput highway to computational materials design
Curtarolo, S., Hart, G. L. W., Nardelli, M. B., Mingo, N., Sanvito, S., & Levy, O. (2013) · Nature Materials · doi:10.1038/nmat3568 · Cited by 2,053
Machine-learning-assisted materials discovery using failed experiments
Raccuglia, P., Elbert, K. C., Adler, P. D. F., Falk, C., Wenny, M. B., Mollo, A., Zeller, M., Friedler, S. A., Schrier, J., & Norquist, A. J. (2016) · Nature · doi:10.1038/nature17439 · Cited by 1,727
Tran, K., & Ulissi, Z. W. (2018) · Nature Catalysis · doi:10.1038/s41929-018-0142-1 · Cited by 920
Big Data Meets Quantum Chemistry Approximations: The Δ-Machine Learning Approach
Ramakrishnan, R., Dral, P. O., Rupp, M., & von Lilienfeld, O. A. (2015) · Journal of Chemical Theory and Computation · doi:10.1021/acs.jctc.5b00099 · Cited by 911
Prediction Errors of Molecular Machine Learning Models Lower than Hybrid DFT Error
Faber, F. A., Hutchison, L., Huang, B., Gilmer, J., Schoenholz, S. S., Dahl, G. E., Vinyals, O., Kearnes, S., Riley, P. F., & von Lilienfeld, O. A. (2017) · Journal of Chemical Theory and Computation · doi:10.1021/acs.jctc.7b00577 · Cited by 651
Materials Synthesis Insights from Scientific Literature via Text Extraction and Machine Learning
Kim, E., Huang, K., Saunders, A., McCallum, A., Ceder, G., & Olivetti, E. (2017) · Chemistry of Materials · doi:10.1021/acs.chemmater.7b03500 · Cited by 473
Virshup, A. M., Contreras-García, J., Wipf, P., Yang, W., & Beratan, D. N. (2013) · Journal of the American Chemical Society · doi:10.1021/ja401184g · Cited by 294
Janet, J. P., & Kulik, H. J. (2017) · The Journal of Physical Chemistry A · doi:10.1021/acs.jpca.7b08750 · Cited by 289
Self-citationA quantitative uncertainty metric controls error in neural network-driven chemical discovery
Janet, J. P., Duan, C., Yang, T., Nandy, A., & Kulik, H. J. (2019) · Chemical Science · doi:10.1039/c9sc02298h · Cited by 243
Self-citationAnthropogenic biases in chemical reaction data hinder exploratory inorganic synthesis
Jia, X., Lynch, A., Huang, Y., Danielson, M., Lang’at, I., Milder, A., Ruby, A. E., Wang, H., Friedler, S. A., Norquist, A. J., et al. (2019) · Nature · doi:10.1038/s41586-019-1540-5 · Cited by 222
Machine learning meets volcano plots: computational discovery of cross-coupling catalysts
Meyer, B., Sawatlon, B., Heinen, S., von Lilienfeld, O. A., & Corminboeuf, C. (2018) · Chemical Science · doi:10.1039/c8sc01949e · Cited by 209
Janet, J. P., Chan, L., & Kulik, H. J. (2018) · The Journal of Physical Chemistry Letters · doi:10.1021/acs.jpclett.8b00170 · Cited by 200
Self-citationJanet, J. P., Ramesh, S., Duan, C., & Kulik, H. J. (2020) · ACS Central Science · doi:10.1021/acscentsci.0c00026 · Cited by 200 · cited 1×
“In a recent example(15), redox couple prediction, which requires three successful geometry optimizations, saw success rates drop from 35% to 20% after five generations of active learning despite a high (50–65%) individual calculation success rate.(15) Some calculation failures are foreseeable, but others are less so.”
BackgroundSelf-citationPredicting electronic structure properties of transition metal complexes with neural networks
Janet, J. P., & Kulik, H. J. (2017) · Chemical Science · doi:10.1039/c7sc01247k · Cited by 199
Self-citationMachine learning dihydrogen activation in the chemical space surrounding Vaska's complex
Friederich, P., dos Passos Gomes, G., De Bin, R., Aspuru-Guzik, A., & Balcells, D. (2020) · Chemical Science · doi:10.1039/d0sc00445f · Cited by 179
Strategies and Software for Machine Learning Accelerated Discovery in Transition Metal Chemistry
Nandy, A., Duan, C., Janet, J. P., Gugler, S., & Kulik, H. J. (2018) · Industrial & Engineering Chemistry Research · doi:10.1021/acs.iecr.8b04015 · Cited by 161
Self-citationCan Single-Reference Coupled Cluster Theory Describe Static Correlation?
Bulik, I. W., Henderson, T. M., & Scuseria, G. E. (2015) · Journal of Chemical Theory and Computation · doi:10.1021/acs.jctc.5b00422 · Cited by 161
Herbol, H. C., Hu, W., Frazier, P., Clancy, P., & Poloczek, M. (2018) · npj Computational Materials · doi:10.1038/s41524-018-0106-7 · Cited by 121
Janet, J. P., Liu, F., Nandy, A., Duan, C., Yang, T., Lin, S., & Kulik, H. J. (2019) · Inorganic Chemistry · doi:10.1021/acs.inorgchem.9b00109 · Cited by 114
Self-citationDuan, C., Janet, J. P., Liu, F., Nandy, A., & Kulik, H. J. (2019) · Journal of Chemical Theory and Computation · doi:10.1021/acs.jctc.9b00057 · Cited by 87 · cited 6×
“88%) of the feasible chemical space is explored in 33% of the computational time (Table 1).(29) Table 1.”
BackgroundMethodInfluentialSelf-citationThe Shape of Full Configuration Interaction to Come
Eriksen, J. J. (2021) · The Journal of Physical Chemistry Letters · doi:10.1021/acs.jpclett.0c03225 · Cited by 66
Liu, F., Duan, C., & Kulik, H. J. (2020) · The Journal of Physical Chemistry Letters · doi:10.1021/acs.jpclett.0c02288 · Cited by 58
Self-citationAdding Stochastic Negative Examples into Machine Learning Improves Molecular Bioactivity Prediction
Cáceres, E. L., Mew, N. C., & Keiser, M. J. (2020) · Journal of Chemical Information and Modeling · doi:10.1021/acs.jcim.0c00565 · Cited by 33
Cited by
Nandy, A., Duan, C., Taylor, M. G., Liu, F., Steeves, A. H., & Kulik, H. J. (2021) · Chemical Reviews · doi:10.1021/acs.chemrev.1c00347 · Cited by 358
Self-citationDuan, C., Chen, S., Taylor, M. G., Liu, F., & Kulik, H. J. (2021) · Chemical Science · doi:10.1039/d1sc03701c · Cited by 40
Self-citationActive meta-learning for predicting and selecting perovskite crystallization experiments
Shekar, V., Nicholas, G., Najeeb, M. A., Zeile, M., Yu, V., Wang, X., Slack, D., Li, Z., Nega, P. W., Chan, E. M., et al. (2022) · The Journal of Chemical Physics · doi:10.1063/5.0076636 · Cited by 25
Metadata
- Authors
- Duan, C., Liu, F., Nandy, A., & Kulik, H. J.
- Venue
- The Journal of Physical Chemistry Letters
- Publisher
- American Chemical Society (ACS)
- Published
- 2021-05-11
- Volume
- 12
- Issue
- 19
- Pages
- 4628-4637
- ISSN
- 1948-7185 (ISSN-L)
- OpenAlex
- W3161867215
- Cited by
- 55
- References
- 25
- FWCI
- 2.82
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.