The DOI matches its Crossref record; 60 of the 60 references it cites were found in a registry or an index.
Predicting the Thermodynamic Stability of Solids Combining Density Functional Theory and Machine Learning
Abstract
We perform a large scale benchmark of machine learning methods for the prediction of the thermodynamic stability of solids. We start by constructing a data set that comprises density functional theory calculations of around 250000 cubic perovskite systems. This includes all possible perovskite and antiperovskite crystals that can be generated with elements from hydrogen to bismuth, excluding rare gases and lanthanides. Incidentally, these calculations already reveal a large number of systems (around 500) that are thermodynamically stable but that are not present in crystal structure databases. Moreover, some of these phases have unconventional compositions and define completely new families of perovskites. This data set is then used to train and test a series of machine learning algorithms to predict the energy distance to the convex hull of stability. In particular, we study the performance of ridge regression, random forests, extremely randomized trees (including adaptive boosting), and neural networks. We find that extremely randomized trees give the smallest mean absolute error of the distance to the convex hull (121 meV/atom) in the test set of 230000 perovskites, after being trained in 20000 samples. Surprisingly, the machine already works if we give it as sole input features the group and row in the periodic table of the three elements composing the perovskite. Moreover, we find that the prediction accuracy is not uniform across the periodic table, being worse for first-row elements and elements forming magnetic compounds. Our results suggest that machine learning can be used to speed up considerably (by at least a factor of 5) high-throughput DFT calculations, by restricting the space of relevant chemical compositions without degradation of the accuracy.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Generalized Gradient Approximation Made Simple
Perdew, J. P., Burke, K., & Ernzerhof, M. (1996) · Physical Review Letters · doi:10.1103/physrevlett.77.3865 · Cited by 215,824
Breiman, L. (2001) · Machine Learning · doi:10.1023/a:1010933404324 · Cited by 133,538
Efficient iterative schemes for ab initio total-energy calculations using a plane-wave basis set
Kresse, G., & Furthmüller, J. (1996) · Physical Review B · doi:10.1103/physrevb.54.11169 · Cited by 123,652
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Projector augmented-wave method
Blöchl, P. E. (1994) · Physical Review B · doi:10.1103/physrevb.50.17953 · Cited by 92,732
Kresse, G., & Furthmüller, J. (1996) · Computational Materials Science · doi:10.1016/0927-0256(96)00008-0 · Cited by 75,638
Scikit-learn: Machine Learning in Python
Pedregosa, F., Varoquaux, G., Gramfort, A., Michel, V., Thirion, B., Grisel, O., Blondel, M., Müller, A., Nothman, J., Louppe, G., et al. (2012) · arXiv · doi:10.48550/arxiv.1201.0490 · Cited by 71,016
Quinlan, J. R. (1986) · Machine Learning · doi:10.1007/bf00116251 · Cited by 21,439
Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification
He, K., Zhang, X., Ren, S., & Sun, J. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.123 · Cited by 19,741
Classification and Regression by randomForest
Liaw, A. I., & Wiener, M. C. (2007) · Cited by 18,594
Research works printed but not linked: 21
- 10.1007/s00339-007-4037-2 · doi:10.1007/s00339-007-4037-2
- 10.1016/j.jssc.2003.10.032 · doi:10.1016/j.jssc.2003.10.032
- 10.1103/PhysRevB.67.094502 · doi:10.1103/physrevb.67.094502
- 10.1016/0021-9614(83)90031-9 · doi:10.1016/0021-9614(83)90031-9
- 10.1143/JPSJ.56.4047 · doi:10.1143/jpsj.56.4047
- 10.1016/j.intermet.2007.09.011 · doi:10.1016/j.intermet.2007.09.011
- 10.1021/ed045p754 · doi:10.1021/ed045p754
- 10.1021/ar00029a004 · doi:10.1021/ar00029a004
- 10.1021/ic00291a050 · doi:10.1021/ic00291a050
- 10.1023/A:1022643204877 · doi:10.1023/a:1022643204877 · Paper page
- 10.1023/A:1018054314350 · doi:10.1023/a:1018054314350 · Paper page
- Timofeev, R.Classification and regression trees (cart) theory and applications. Master’s thesis,Humboldt University,Berlin, Germany, 2004.
- Maas, A. L.; Hannun, A. Y.; Ng, A. Y.Rectifier nonlinearities improve neural network acoustic models.Proceedings of the 30th international conference on machine learning;Association for Computational Linguistics, 2013.
- Drucker, H.Improving regressors using boosting techniques.Proceedings of the fourteeth international conference on machine learning;Morgan Kaufmann, 1997; pp107–115.
- Freund, Y.; Schapire, R. E.Experiments with a new boosting algorithm.Proceedings of the thirteenth international conference on machine learning;Saitta, L., Ed.Morgan Kaufmann, 1996; pp148–156.
- Pedregosa F., 2011, J. Mach. Learn. Res., 12, 2825
- Liaw A., 2013, R News, 2, 18
- 10.1021/acs.jctc.5b00529 · doi:10.1021/acs.jctc.5b00529
- 10.1103/PhysRevB.91.165121 · doi:10.1103/physrevb.91.165121
- Miessler G. L., 2013, Inorganic Chemistry: Pearson New International Edition
- 10.1002/anie.198402721 · doi:10.1002/anie.198402721
Cited by
Recent advances and applications of machine learning in solid-state materials science
Schmidt, J., Marques, M. R. G., Botti, S., & Marques, M. A. L. (2019) · npj Computational Materials · doi:10.1038/s41524-019-0221-0 · Cited by 2,607
Self-citationNew tolerance factor to predict the stability of perovskite oxides and halides
Bartel, C. J., Sutton, C., Goldsmith, B. R., Ouyang, R., Musgrave, C. B., Ghiringhelli, L. M., & Scheffler, M. (2019) · Science Advances · doi:10.1126/sciadv.aav0693 · Cited by 1,838
From DFT to machine learning: recent approaches to materials science–a review
Schleder, G. R., Padilha, A. C. M., Acosta, C. M., Costa, M., & Fazzio, A. (2019) · Journal of Physics: Materials · doi:10.1088/2515-7639/ab084b · Cited by 852
A strategy to apply machine learning to small datasets in materials science
Zhang, Y., & Ling, C. (2018) · npj Computational Materials · doi:10.1038/s41524-018-0081-z · Cited by 776
Accelerated discovery of stable lead-free hybrid organic-inorganic perovskites via machine learning
Lu, S., Zhou, Q., Ouyang, Y., Guo, Y., Li, Q., & Wang, J. (2018) · Nature Communications · doi:10.1038/s41467-018-05761-w · Cited by 725
Big-Data Science in Porous Materials: Materials Genomics and Machine Learning
Jablonka, K. M., Ongari, D., Moosavi, S. M., & Smit, B. (2020) · Chemical Reviews · doi:10.1021/acs.chemrev.0c00004 · Cited by 599
Machine learning for perovskite materials design and discovery
Tao, Q., Xu, P., Li, M., & Lu, W. (2021) · npj Computational Materials · doi:10.1038/s41524-021-00495-8 · Cited by 542
ElemNet: Deep Learning the Chemistry of Materials From Only Elemental Composition
Jha, D., Ward, L., Paul, A., Liao, W.-K., Choudhary, A., Wolverton, C., & Agrawal, A. (2018) · Scientific Reports · doi:10.1038/s41598-018-35934-y · Cited by 510
Machine Learning for Materials Scientists: An Introductory Guide toward Best Practices
Wang, A. Y.-T., Murdock, R. J., Kauwe, S. K., Oliynyk, A. O., Gurlo, A., Brgoch, J., Persson, K. A., & Sparks, T. D. (2020) · Chemistry of Materials · doi:10.1021/acs.chemmater.0c01907 · Cited by 509
Machine learning assisted materials design and discovery for rechargeable batteries
Liu, Y., Guo, B., Zou, X., Li, Y., & Shi, S. (2020) · Energy Storage Materials · doi:10.1016/j.ensm.2020.06.033 · Cited by 466
Machine learning: Accelerating materials development for energy storage and conversion
Chen, A., Zhang, X., & Zhou, Z. (2020) · InfoMat · doi:10.1002/inf2.12094 · Cited by 370
Machine Learning for Computational Heterogeneous Catalysis
Schlexer Lamoureux, P., Winther, K. T., Garrido Torres, J. A., Streibel, V., Zhao, M., Bajdich, M., Abild‐Pedersen, F., & Bligaard, T. (2019) · ChemCatChem · doi:10.1002/cctc.201900595 · Cited by 356
Crystal Structure Prediction via Deep Learning
Ryan, K., Lengyel, J., & Shatruk, M. (2018) · Journal of the American Chemical Society · doi:10.1021/jacs.8b03913 · Cited by 355
Jha, D., Choudhary, K., Tavazza, F., Liao, W.-K., Choudhary, A., Campbell, C., & Agrawal, A. (2019) · Nature Communications · doi:10.1038/s41467-019-13297-w · Cited by 339
Toward Eco-friendly and Stable Perovskite Materials for Photovoltaics
Ju, M.-G., Chen, M., Zhou, Y., Dai, J., Ma, L., Padture, N. P., & Zeng, X. C. (2018) · Joule · doi:10.1016/j.joule.2018.04.026 · Cited by 330
Zhi, W., Feng, D., Tsai, W.-P., Sterle, G., Harpold, A., Shen, C., & Li, L. (2021) · Environmental Science & Technology · doi:10.1021/acs.est.0c06783 · Cited by 329
Machine learning for renewable energy materials
Gu, G. H., Noh, J., Kim, I., & Jung, Y. (2019) · Journal of Materials Chemistry A · doi:10.1039/c9ta02356a · Cited by 311
Yan, Y., Borhani, T. N., Subraveti, S. G., Pai, K. N., Prasad, V., Rajendran, A., Nkulikiyinka, P., Asibor, J. O., Zhang, Z., Shao, D., et al. (2021) · Energy & Environmental Science · doi:10.1039/d1ee02395k · Cited by 306
Antiperovskite Electrolytes for Solid-State Batteries
Xia, W., Zhao, Y., Zhao, F., Adair, K., Zhao, R., Li, S., Zou, R., Zhao, Y., & Sun, X. (2022) · Chemical Reviews · doi:10.1021/acs.chemrev.1c00594 · Cited by 288
Park, C. W., & Wolverton, C. (2020) · Physical Review Materials · doi:10.1103/physrevmaterials.4.063801 · Cited by 281
Deep neural networks for accurate predictions of crystal stability
Ye, W., Chen, C., Wang, Z., Chu, I.-H., & Ong, S. P. (2018) · Nature Communications · doi:10.1038/s41467-018-06322-x · Cited by 263
Applying machine learning techniques to predict the properties of energetic materials
Elton, D. C., Boukouvalas, Z., Butrico, M. S., Fuge, M. D., & Chung, P. W. (2018) · Scientific Reports · doi:10.1038/s41598-018-27344-x · Cited by 263
Predicting the thermodynamic stability of perovskite oxides using machine learning models
Li, W., Jacobs, R., & Morgan, D. (2018) · Computational Materials Science · doi:10.1016/j.commatsci.2018.04.033 · Cited by 255
Li, Z., Xu, Q., Sun, Q., Hou, Z., & Yin, W. (2019) · Advanced Functional Materials · doi:10.1002/adfm.201807280 · Cited by 233
Innovative Materials Science via Machine Learning
Gao, C., Min, X., Fang, M., Tao, T., Zheng, X., Liu, Y., Wu, X., & Huang, Z. (2022) · Advanced Functional Materials · doi:10.1002/adfm.202108044 · Cited by 198
Machine Learning for Perovskite Solar Cells and Component Materials: Key Technologies and Prospects
Liu, Y., Tan, X., Liang, J., Han, H., Xiang, P., & Yan, W. (2023) · Advanced Functional Materials · doi:10.1002/adfm.202214271 · Cited by 174
Talapatra, A., Uberuaga, B. P., Stanek, C. R., & Pilania, G. (2021) · Chemistry of Materials · doi:10.1021/acs.chemmater.0c03402 · Cited by 149
Application of machine learning for advanced material prediction and design
Chan, C. H., Sun, M., & Huang, B. (2022) · EcoMat · doi:10.1002/eom2.12194 · Cited by 123
Gao, Z., Zhang, H., Mao, G., Ren, J., Chen, Z., Wu, C., Gates, I. D., Yang, W., Ding, X., & Yao, J. (2021) · Applied Surface Science · doi:10.1016/j.apsusc.2021.150916 · Cited by 101
Applications of machine learning in perovskite materials
Wang, Z., Yang, M., Xie, X., Yu, C., Jiang, Q., Huang, M., Algadi, H., Guo, Z., & Zhang, H. (2022) · Advanced Composites and Hybrid Materials · doi:10.1007/s42114-022-00560-w · Cited by 81
Computational Screening of New Perovskite Materials Using Transfer Learning and Deep Learning
Li, X., Dan, Y., Dong, R., Cao, Z., Niu, C., Song, Y., Li, S., & Hu, J. (2019) · Applied Sciences · doi:10.3390/app9245510 · Cited by 74
Topological feature engineering for machine learning based halide perovskite materials design
Anand, D. V., Xu, Q., Wee, J., Xia, K., & Sum, T. C. (2022) · npj Computational Materials · doi:10.1038/s41524-022-00883-8 · Cited by 72
Machine learning in materials design: Algorithm and application*
Song, Z., Chen, X., Meng, F., Cheng, G., Wang, C., Sun, Z., & Yin, W.-J. (2020) · Chinese Physics B · doi:10.1088/1674-1056/abc0e3 · Cited by 63
A machine learning model for screening thermodynamic stable lead-free halide double perovskites
Liang, G.-Q., & Zhang, J. (2022) · Computational Materials Science · doi:10.1016/j.commatsci.2021.111172 · Cited by 44
Li, C., Hao, H., Xu, B., Shen, Z., Zhou, E., Jiang, D., & Liu, H. (2021) · Computational Materials Science · doi:10.1016/j.commatsci.2021.110714 · Cited by 32
Xiong, Y., Chen, W., Guo, W., Wei, H., & Dabo, I. (2021) · Physical Chemistry Chemical Physics · doi:10.1039/d0cp05595f · Cited by 16
Metadata
- Authors
- Schmidt, J., Shi, J., Borlido, P., Chen, L., Botti, S., & Marques, M. A. L.
- Venue
- Chemistry of Materials
- Publisher
- American Chemical Society (ACS)
- Published
- 2017-06-07
- Volume
- 29
- Issue
- 12
- Pages
- 5090-5103
- ISSN
- 0897-4756 (ISSN-L)
- 1520-5002
- OpenAlex
- W2616519837
- Cited by
- 341
- References
- 60
- FWCI
- 9.94
- Type
- journal article
- Language
- en
- Open access
- closed
- Funders
- Deutsche Forschungsgemeinschaft (MA-6786/1, SFB-762)
- China Scholarship Council
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.