The DOI matches its Crossref record; 60 of the 60 references it cites were found in a registry or an index.
Predicting the Thermodynamic Stability of Solids Combining Density Functional Theory and Machine Learning
Abstract
We perform a large scale benchmark of machine learning methods for the prediction of the thermodynamic stability of solids. We start by constructing a data set that comprises density functional theory calculations of around 250000 cubic perovskite systems. This includes all possible perovskite and antiperovskite crystals that can be generated with elements from hydrogen to bismuth, excluding rare gases and lanthanides. Incidentally, these calculations already reveal a large number of systems (around 500) that are thermodynamically stable but that are not present in crystal structure databases. Moreover, some of these phases have unconventional compositions and define completely new families of perovskites. This data set is then used to train and test a series of machine learning algorithms to predict the energy distance to the convex hull of stability. In particular, we study the performance of ridge regression, random forests, extremely randomized trees (including adaptive boosting), and neural networks. We find that extremely randomized trees give the smallest mean absolute error of the distance to the convex hull (121 meV/atom) in the test set of 230000 perovskites, after being trained in 20000 samples. Surprisingly, the machine already works if we give it as sole input features the group and row in the periodic table of the three elements composing the perovskite. Moreover, we find that the prediction accuracy is not uniform across the periodic table, being worse for first-row elements and elements forming magnetic compounds. Our results suggest that machine learning can be used to speed up considerably (by at least a factor of 5) high-throughput DFT calculations, by restricting the space of relevant chemical compositions without degradation of the accuracy.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Generalized Gradient Approximation Made Simple
Perdew, J. P., Burke, K., & Ernzerhof, M. (1996) · Physical Review Letters · doi:10.1103/physrevlett.77.3865 · Cited by 215,824
Breiman, L. (2001) · Machine Learning · doi:10.1023/a:1010933404324 · Cited by 133,538
Efficient iterative schemes for ab initio total-energy calculations using a plane-wave basis set
Kresse, G., & Furthmüller, J. (1996) · Physical Review B · doi:10.1103/physrevb.54.11169 · Cited by 123,652
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Projector augmented-wave method
Blöchl, P. E. (1994) · Physical Review B · doi:10.1103/physrevb.50.17953 · Cited by 92,732
Kresse, G., & Furthmüller, J. (1996) · Computational Materials Science · doi:10.1016/0927-0256(96)00008-0 · Cited by 75,638
Scikit-learn: Machine Learning in Python
Pedregosa, F., Varoquaux, G., Gramfort, A., Michel, V., Thirion, B., Grisel, O., Blondel, M., Müller, A., Nothman, J., Louppe, G., et al. (2012) · arXiv · doi:10.48550/arxiv.1201.0490 · Cited by 71,016
Quinlan, J. R. (1986) · Machine Learning · doi:10.1007/bf00116251 · Cited by 21,439
Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification
He, K., Zhang, X., Ren, S., & Sun, J. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.123 · Cited by 19,741
Classification and Regression by randomForest
Liaw, A. I., & Wiener, M. C. (2007) · Cited by 18,594
Breiman, L. (1996) · Machine Learning · doi:10.1007/bf00058655 · Cited by 16,325
Mastering the game of Go with deep neural networks and tree search
Silver, D., Huang, A., Maddison, C. J., Guez, A., Sifre, L., van den Driessche, G., Schrittwieser, J., Antonoglou, I., Panneershelvam, V., Lanctot, M., et al. (2016) · Nature · doi:10.1038/nature16961 · Cited by 15,612
FaceNet: A unified embedding for face recognition and clustering
Schroff, F., Kalenichenko, D., & Philbin, J. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298682 · Cited by 15,267
Commentary: The Materials Project: A materials genome approach to accelerating materials innovation
Jain, A., Ong, S. P., Hautier, G., Chen, W., Richards, W. D., Dacek, S., Cholia, S., Gunter, D., Skinner, D., Ceder, G., et al. (2013) · APL Materials · doi:10.1063/1.4812323 · Cited by 13,094
Caffe: Convolutional Architecture for Fast Feature Embedding
Jia, Y., Shelhamer, E., Donahue, J., Karayev, S., Long, J., Girshick, R., Guadarrama, S., & Darrell, T. (2014) · Proceedings of the 22nd ACM international conference on Multimedia · doi:10.1145/2647868.2654889 · Cited by 11,077
Classification and regression trees
Praagman, J. (1985) · European Journal of Operational Research · doi:10.1016/0377-2217(85)90321-2 · Cited by 10,053
Geurts, P., Ernst, D., & Wehenkel, L. (2006) · Machine Learning · doi:10.1007/s10994-006-6226-1 · Cited by 9,300
Learning long-term dependencies with gradient descent is difficult
Bengio, Y., Simard, P., & Frasconi, P. (1994) · IEEE Transactions on Neural Networks · doi:10.1109/72.279181 · Cited by 8,542
Python Materials Genomics (pymatgen): A robust, open-source python library for materials analysis
Ong, S. P., Richards, W. D., Jain, A., Hautier, G., Kocher, M., Cholia, S., Gunter, D., Chevrier, V. L., Persson, K. A., & Ceder, G. (2013) · Computational Materials Science · doi:10.1016/j.commatsci.2012.10.028 · Cited by 4,534
Die Gesetze der Krystallochemie
Goldschmidt, V. M. (1926) · Die Naturwissenschaften · doi:10.1007/bf01507527 · Cited by 4,012
End to End Learning for Self-Driving Cars
Bojarski, M., Del Testa, D., Dworakowski, D., Firner, B., Flepp, B., Goyal, P., Jackel, L. D., Monfort, M., Muller, U., Zhang, J., et al. (2016) · arXiv · doi:10.48550/arxiv.1604.07316 · Cited by 3,198
Saal, J. E., Kirklin, S., Aykol, M., Meredig, B., & Wolverton, C. (2013) · JOM · doi:10.1007/s11837-013-0755-4 · Cited by 2,584
Quinlan, J. R. (1987) · International Journal of Man-Machine Studies · doi:10.1016/s0020-7373(87)80053-6 · Cited by 2,553
Fast and Accurate Modeling of Molecular Atomization Energies with Machine Learning
Rupp, M., Tkatchenko, A., Müller, K.-R., & von Lilienfeld, O. A. (2012) · Physical Review Letters · doi:10.1103/physrevlett.108.058301 · Cited by 2,312
Deep Learning Face Representation from Predicting 10,000 Classes
Sun, Y., Wang, X., & Tang, X. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.244 · Cited by 1,997
Atom-centered symmetry functions for constructing high-dimensional neural network potentials
Behler, J. (2011) · The Journal of Chemical Physics · doi:10.1063/1.3553717 · Cited by 1,610
Feature selection, L 1 vs. L 2 regularization, and rotational invariance
Ng, A. Y. (2004) · Twenty-first international conference on Machine learning - ICML '04 · doi:10.1145/1015330.1015435 · Cited by 1,572
Belsky, A., Hellenbrandt, M., Karen, V. L., & Luksch, P. (2002) · Acta Crystallographica Section B Structural Science · doi:10.1107/s0108768102006948 · Cited by 1,379
Curtarolo, S., Setyawan, W., Wang, S., Xue, J., Yang, K., Taylor, R. H., Nelson, L. J., Hart, G. L. W., Sanvito, S., Buongiorno-Nardelli, M., et al. (2012) · Computational Materials Science · doi:10.1016/j.commatsci.2012.02.002 · Cited by 1,148
Machine Learning: An Algorithmic Perspective
Marsland, S. (2009) · Cited by 1,068
Big Data of Materials Science: Critical Role of the Descriptor
Ghiringhelli, L. M., Vybiral, J., Levchenko, S. V., Draxl, C., & Scheffler, M. (2015) · Physical Review Letters · doi:10.1103/physrevlett.114.105503 · Cited by 920
Accelerating materials property predictions using machine learning
Pilania, G., Wang, C., Jiang, X., Rajasekaran, S., & Ramprasad, R. (2013) · Scientific Reports · doi:10.1038/srep02810 · Cited by 853
Combinatorial screening for new materials in unconstrained composition space with machine learning
Meredig, B., Agrawal, A., Kirklin, S., Saal, J. E., Doak, J. W., Thompson, A., Zhang, K., Choudhary, A., & Wolverton, C. (2014) · Physical Review B · doi:10.1103/physrevb.89.094104 · Cited by 730
Superconductivity in the non-oxide perovskite MgCNi3
He, T., Huang, Q., Ramirez, A. P., Wang, Y., Regan, K. A., Rogado, N., Hayward, M. A., Haas, M. K., Slusky, J. S., Inumara, K., et al. (2001) · Nature · doi:10.1038/35075014 · Cited by 663
Stevanović, V., Lany, S., Zhang, X., & Zunger, A. (2012) · Physical Review B · doi:10.1103/physrevb.85.115104 · Cited by 650
Identification and design principles of low hole effective mass p-type transparent conducting oxides
Hautier, G., Miglio, A., Ceder, G., Rignanese, G.-M., & Gonze, X. (2013) · Nature Communications · doi:10.1038/ncomms3292 · Cited by 640
Machine learning bandgaps of double perovskites
Pilania, G., Mannodi-Kanakkithodi, A., Uberuaga, B. P., Ramprasad, R., Gubernatis, J. E., & Lookman, T. (2016) · Scientific Reports · doi:10.1038/srep19375 · Cited by 518
Hautier, G., Ong, S. P., Jain, A., Moore, C. J., & Ceder, G. (2012) · Physical Review B · doi:10.1103/physrevb.85.155208 · Cited by 506
Schütt, K. T., Glawe, H., Brockherde, F., Sanna, A., Müller, K. R., & Gross, E. K. U. (2014) · Physical Review B · doi:10.1103/physrevb.89.205118 · Cited by 469
Crystal structure representations for machine learning models of formation energies
Faber, F., Lindmaa, A., von Lilienfeld, O. A., & Armiento, R. (2015) · International Journal of Quantum Chemistry · doi:10.1002/qua.24917 · Cited by 462
Machine Learning Energies of 2 Million Elpasolite(ABC2D6)Crystals
Faber, F. A., Lindmaa, A., von Lilienfeld, O. A., & Armiento, R. (2016) · Physical Review Letters · doi:10.1103/physrevlett.117.135502 · Cited by 409
Adaptive machine learning framework to accelerate ab initio molecular dynamics
Botu, V., & Ramprasad, R. (2015) · International Journal of Quantum Chemistry · doi:10.1002/qua.24836 · Cited by 395
PlaNet - Photo Geolocation with Convolutional Neural Networks
Weyand, T., Kostrikov, I., & Philbin, J. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46484-8_3 · Cited by 395
Machine Learning Strategy for Accelerated Design of Polymer Dielectrics
Mannodi-Kanakkithodi, A., Pilania, G., Huan, T. D., Lookman, T., & Ramprasad, R. (2016) · Scientific Reports · doi:10.1038/srep20952 · Cited by 389
High-Throughput Machine-Learning-Driven Synthesis of Full-Heusler Compounds
Oliynyk, A. O., Antono, E., Sparks, T. D., Ghadbeigi, L., Gaultois, M. W., Meredig, B., & Mar, A. (2016) · Chemistry of Materials · doi:10.1021/acs.chemmater.6b02724 · Cited by 387
Carrete, J., Li, W., Mingo, N., Wang, S., & Stefano Curtarolo, A. (2014) · Physical Review X · doi:10.5281/zenodo.10562670 · Cited by 368
Lee, J., Seko, A., Shitara, K., Nakayama, K., & Tanaka, I. (2016) · Physical Review B · doi:10.1103/physrevb.93.115104 · Cited by 336
Rational design of all organic polymer dielectrics
Sharma, V., Wang, C., Lorenzini, R. G., Ma, R., Zhu, Q., Sinkovits, D. W., Pilania, G., Oganov, A. R., Kumar, S., Sotzing, G. A., et al. (2014) · Nature Communications · doi:10.1038/ncomms5845 · Cited by 335
A chemical scale for crystal-structure maps
Pettifor, D. G. (1984) · Solid State Communications · doi:10.1016/0038-1098(84)90765-8 · Cited by 264
Carrete, J., Li, W., Mingo, N., Wang, S., & Curtarolo, S. (2014) · Physical Review X · doi:10.1103/physrevx.4.011019 · Cited by 264
Ceder, G. (2010) · MRS Bulletin · doi:10.1557/mrs2010.681 · Cited by 257
First-principles structural design of superhard materials
Zhang, X., Wang, Y., Lv, J., Zhu, C., Li, Q., Zhang, M., Li, Q., & Ma, Y. (2013) · The Journal of Chemical Physics · doi:10.1063/1.4794424 · Cited by 225
Massa, W. (2000) · Crystal Structure Determination · doi:10.1007/978-3-662-04248-9_13 · Cited by 193
Accelerated materials property predictions and design using motif-based fingerprints
Huan, T. D., Mannodi-Kanakkithodi, A., & Ramprasad, R. (2015) · Physical Review B · doi:10.1103/physrevb.92.014106 · Cited by 168
Informatics-aided bandgap engineering for solar materials
Dey, P. P., Bible, J., Datta, S., Broderick, S., Jasinski, J. B., Sunkara, M. K., Menon, M., & Rajan, K. (2013) · Computational Materials Science · doi:10.1016/j.commatsci.2013.10.016 · Cited by 156
Prediction of Stable Nitride Perovskites
Sarmiento-Pérez, R., Cerqueira, T. F. T., Körbel, S., Botti, S., & Marques, M. A. L. (2015) · Chemistry of Materials · doi:10.1021/acs.chemmater.5b02026 · Cited by 150
Self-citationHigh-throughput and data mining with ab initio methods
Morgan, D. D., Ceder, G., & Stefano Curtarolo, A. (2004) · Measurement Science and Technology · doi:10.1088/0957-0233/16/1/039 · Cited by 116
Optimizing transition states via kernel-based machine learning
Pozun, Z. D., Hansen, K., Sheppard, D., Rupp, M., Müller, K., & Henkelman, G. (2012) · The Journal of Chemical Physics · doi:10.1063/1.4707167 · Cited by 111
Second Order Properties of Error Surfaces: Learning Time and Generalization
LeCun, Y., Kanter, I., & Solla, S. A. (1990) · neural information processing systems · Cited by 68
Ab initio screening methodology applied to the search for new permanent magnetic materials
Drebov, N., Martinez-Limia, A., Kunz, L., Gola, A., Shigematsu, T., Eckl, T., Gumbsch, P., & Elsässer, C. (2013) · New Journal of Physics · doi:10.1088/1367-2630/15/12/125023 · Cited by 64
Research works printed but not linked: 21
- 10.1007/s00339-007-4037-2 · doi:10.1007/s00339-007-4037-2
- 10.1016/j.jssc.2003.10.032 · doi:10.1016/j.jssc.2003.10.032
- 10.1103/PhysRevB.67.094502 · doi:10.1103/physrevb.67.094502
- 10.1016/0021-9614(83)90031-9 · doi:10.1016/0021-9614(83)90031-9
- 10.1143/JPSJ.56.4047 · doi:10.1143/jpsj.56.4047
- 10.1016/j.intermet.2007.09.011 · doi:10.1016/j.intermet.2007.09.011
- 10.1021/ed045p754 · doi:10.1021/ed045p754
- 10.1021/ar00029a004 · doi:10.1021/ar00029a004
- 10.1021/ic00291a050 · doi:10.1021/ic00291a050
- 10.1023/A:1022643204877 · doi:10.1023/a:1022643204877 · Paper page
- 10.1023/A:1018054314350 · doi:10.1023/a:1018054314350 · Paper page
- Timofeev, R.Classification and regression trees (cart) theory and applications. Master’s thesis,Humboldt University,Berlin, Germany, 2004.
- Maas, A. L.; Hannun, A. Y.; Ng, A. Y.Rectifier nonlinearities improve neural network acoustic models.Proceedings of the 30th international conference on machine learning;Association for Computational Linguistics, 2013.
- Drucker, H.Improving regressors using boosting techniques.Proceedings of the fourteeth international conference on machine learning;Morgan Kaufmann, 1997; pp107–115.
- Freund, Y.; Schapire, R. E.Experiments with a new boosting algorithm.Proceedings of the thirteenth international conference on machine learning;Saitta, L., Ed.Morgan Kaufmann, 1996; pp148–156.
- Pedregosa F., 2011, J. Mach. Learn. Res., 12, 2825
- Liaw A., 2013, R News, 2, 18
- 10.1021/acs.jctc.5b00529 · doi:10.1021/acs.jctc.5b00529
- 10.1103/PhysRevB.91.165121 · doi:10.1103/physrevb.91.165121
- Miessler G. L., 2013, Inorganic Chemistry: Pearson New International Edition
- 10.1002/anie.198402721 · doi:10.1002/anie.198402721
Cited by
Recent advances and applications of machine learning in solid-state materials science
Schmidt, J., Marques, M. R. G., Botti, S., & Marques, M. A. L. (2019) · npj Computational Materials · doi:10.1038/s41524-019-0221-0 · Cited by 2,607
Self-citationNew tolerance factor to predict the stability of perovskite oxides and halides
Bartel, C. J., Sutton, C., Goldsmith, B. R., Ouyang, R., Musgrave, C. B., Ghiringhelli, L. M., & Scheffler, M. (2019) · Science Advances · doi:10.1126/sciadv.aav0693 · Cited by 1,838
From DFT to machine learning: recent approaches to materials science–a review
Schleder, G. R., Padilha, A. C. M., Acosta, C. M., Costa, M., & Fazzio, A. (2019) · Journal of Physics: Materials · doi:10.1088/2515-7639/ab084b · Cited by 852
A strategy to apply machine learning to small datasets in materials science
Zhang, Y., & Ling, C. (2018) · npj Computational Materials · doi:10.1038/s41524-018-0081-z · Cited by 776
Accelerated discovery of stable lead-free hybrid organic-inorganic perovskites via machine learning
Lu, S., Zhou, Q., Ouyang, Y., Guo, Y., Li, Q., & Wang, J. (2018) · Nature Communications · doi:10.1038/s41467-018-05761-w · Cited by 725
Metadata
- Authors
- Schmidt, J., Shi, J., Borlido, P., Chen, L., Botti, S., & Marques, M. A. L.
- Venue
- Chemistry of Materials
- Publisher
- American Chemical Society (ACS)
- Published
- 2017-06-07
- Volume
- 29
- Issue
- 12
- Pages
- 5090-5103
- ISSN
- 0897-4756 (ISSN-L)
- 1520-5002
- OpenAlex
- W2616519837
- Cited by
- 341
- References
- 60
- FWCI
- 9.94
- Type
- journal article
- Language
- en
- Open access
- closed
- Funders
- Deutsche Forschungsgemeinschaft (MA-6786/1, SFB-762)
- China Scholarship Council
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.