Cross-property deep transfer learning framework for enhanced predictive analytics on small materials data
Open accessThe DOI matches its Crossref record; 16 of the 16 references it cites were found in a registry or an index.
Abstract
Artificial intelligence (AI) and machine learning (ML) have been increasingly used in materials science to build predictive models and accelerate discovery. For selected properties, availability of large databases has also facilitated application of deep learning (DL) and transfer learning (TL). However, unavailability of large datasets for a majority of properties prohibits widespread application of DL/TL. We present a cross-property deep-transfer-learning framework that leverages models trained on large datasets to build models on small datasets of different properties. We test the proposed framework on 39 computational and two experimental datasets and find that the TL models with only elemental fractions as input outperform ML/DL models trained from scratch even when they are allowed to use physical attributes as input, for 27/39 (≈ 69%) computational and both the experimental datasets. We believe that the proposed framework can be widely useful to tackle the small data challenge in applying AI/ML in materials science.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Commentary: The Materials Project: A materials genome approach to accelerating materials innovation
Jain, A., Ong, S. P., Hautier, G., Chen, W., Richards, W. D., Dacek, S., Cholia, S., Gunter, D., Skinner, D., Ceder, G., et al. (2013) · APL Materials · doi:10.1063/1.4812323 · Cited by 13,094 · cited 1×
“…– 23 , mostly based on simulations such as density functional theory (DFT) 24 , e.g., Open Quantum Materials Database (OQMD) 19 , Automatic Flow of Materials Discovery Library (AFLOWLIB) 20 , Materials Project (MP) 21 , and Joint Automated Repository for Various Integrated Simulations (JARVIS) 22 .”
TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems
Abadi, M., Agarwal, A., Barham, P., Brevdo, E., Chen, Z., Citro, C., Corrado, G. S., Davis, A., Dean, J., Devin, M., et al. (2016) · arXiv · doi:10.48550/arxiv.1603.04467 · Cited by 9,408
Dropout as a bayesian approximation: Representing model uncertainty in deep learning
Gal, Y., & Ghahramani, Z. (2015) · arXiv · doi:10.48550/arxiv.1506.02142 · Cited by 6,471
Machine learning for molecular and materials science
Butler, K. T., Davies, D. W., Cartwright, H., Isayev, O., & Walsh, A. (2018) · Nature · doi:10.1038/s41586-018-0337-2 · Cited by 4,968
Xie, T., & Grossman, J. C. (2018) · Physical Review Letters · doi:10.1103/physrevlett.120.145301 · Cited by 2,828 · cited 1×
“…cross-property TL work fl ow by incorporating structure-based information into the work fl ow via vector-based structural attributes with fully connected deep neural networks 31,74,75 or graph-based neural networks 52,72,73 , if structural information is available for both source and target datasets.”
BackgroundSchNet – A deep learning architecture for molecules and materials
Schütt, K. T., Sauceda, H. E., Kindermans, P.-J., Tkatchenko, A., & Müller, K.-R. (2018) · The Journal of Chemical Physics · doi:10.1063/1.5019779 · Cited by 2,217 · cited 2×
“…cross-property TL work fl ow by incorporating structure-based information into the work fl ow via vector-based structural attributes with fully connected deep neural networks 31,74,75 or graph-based neural networks 52,72,73 , if structural information is available for both source and target datasets.”
BackgroundThe high-throughput highway to computational materials design
Curtarolo, S., Hart, G. L. W., Nardelli, M. B., Mingo, N., Sanvito, S., & Levy, O. (2013) · Nature Materials · doi:10.1038/nmat3568 · Cited by 2,053 · cited 8×
“This has been made possible due to the increasing availability of large materials databases 19 – 23 , mostly based on simulations such as density functional theory (DFT) 24 , e.g., Open Quantum Materials Database (OQMD) 19 , Automatic Flow of Materials Discovery Library (AFLOWLIB) 20 , Materials Project (MP) 21 , and…”
BackgroundInfluentialMachine learning in materials informatics: recent applications and prospects
Ramprasad, R., Batra, R., Pilania, G., Mannodi-Kanakkithodi, A., & Kim, C. (2017) · npj Computational Materials · doi:10.1038/s41524-017-0056-5 · Cited by 1,945
A general-purpose machine learning framework for predicting properties of inorganic materials
Ward, L., Agrawal, A., Choudhary, A., & Wolverton, C. (2016) · npj Computational Materials · doi:10.1038/npjcompumats.2016.28 · Cited by 1,831
Self-citationGraph Networks as a Universal Machine Learning Framework for Molecules and Crystals
Chen, C., Ye, W., Zuo, Y., Zheng, C., & Ong, S. P. (2019) · Chemistry of Materials · doi:10.1021/acs.chemmater.9b01294 · Cited by 1,552
Cited by
Recent advances and applications of deep learning methods in materials science
Choudhary, K., DeCost, B., Chen, C., Jain, A., Tavazza, F., Cohn, R., Park, C. W., Choudhary, A., Agrawal, A., Billinge, S. J. L., et al. (2022) · npj Computational Materials · doi:10.1038/s41524-022-00734-6 · Cited by 1,172
“They have also been used for transfer learning across datasets for enhanced predictive accuracy on small data [34], even for different source and target properties [167].”
MethodSelf-citationA review on machine learning-guided design of energy materials
Kim, S., Xu, J., Shang, W., Xu, Z., Lee, E., & Luo, T. (2024) · Progress in Energy · doi:10.1088/2516-1083/ad7220 · Cited by 19
Metadata
- Authors
- Gupta, V., Choudhary, K., Tavazza, F., Campbell, C., Liao, W.-K., Choudhary, A., & Agrawal, A.
- Venue
- Nature Communications
- Published
- 2021-11-15
- Volume
- 12
- Issue
- 1
- Pages
- 6595-6595
- ISSN
- 2041-1723 (ISSN-L)
- OpenAlex
- W3213348597
- Cited by
- 198
- References
- 16
- FWCI
- 7.23
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Cross-property deep transfer learning framework for enhanced predictive analytics on small materials data. https://app.cochat.ai/papers/10.1038/s41467-021-26921-5
- The paper
- Gupta, V., Choudhary, K., Tavazza, F., Campbell, C., Liao, W.-K., Choudhary, A., & Agrawal, A. (2021). Cross-property deep transfer learning framework for enhanced predictive analytics on small materials data. Nature Communications. https://doi.org/10.1038/s41467-021-26921-5
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.