Machine-learning-assisted materials discovery using failed experiments
The DOI matches its Crossref record; 38 of the 38 references it cites were found in a registry or an index.
Abstract
Inorganic-organic hybrid materials such as organically templated metal oxides, metal-organic frameworks (MOFs) and organohalide perovskites have been studied for decades, and hydrothermal and (non-aqueous) solvothermal syntheses have produced thousands of new materials that collectively contain nearly all the metals in the periodic table. Nevertheless, the formation of these compounds is not fully understood, and development of new compounds relies primarily on exploratory syntheses. Simulation- and data-driven approaches (promoted by efforts such as the Materials Genome Initiative) provide an alternative to experimental trial-and-error. Three major strategies are: simulation-based predictions of physical properties (for example, charge mobility, photovoltaic properties, gas adsorption capacity or lithium-ion intercalation) to identify promising target candidates for synthetic efforts; determination of the structure-property relationship from large bodies of experimental data, enabled by integration with high-throughput synthesis and measurement tools; and clustering on the basis of similar crystallographic structure (for example, zeolite structure classification or gas adsorption properties). Here we demonstrate an alternative approach that uses machine-learning algorithms trained on reaction data to predict reaction outcomes for the crystallization of templated vanadium selenites. We used information on 'dark' reactions--failed or unsuccessful hydrothermal syntheses--collected from archived laboratory notebooks from our laboratory, and added physicochemical property descriptions to the raw notebook information using cheminformatics techniques. We used the resulting data to train a machine-learning model to predict reaction success. When carrying out hydrothermal synthesis experiments using previously untested, commercially available organic building blocks, our machine-learning model outperformed traditional human strategies, and successfully predicted conditions for new organically templated inorganic product formation with a success rate of 89 per cent. Inverting the machine-learning model reveals new hypotheses regarding the conditions for successful product formation.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“For example, in experimental data sets extracted from the literature (14,15,19), there can be positive bias for reporting only successful experiments (16, 107, 108), leading to challenges in classification tasks (17).”
From Machine Learning for the Discovery, Design, and Engineering of Materials. (2022) · cites this paper as [108]
In the citing paper
“ML has had recent success in predicting specific chemical, material, and optical properties without the need for expensive experimentation or brute-force simulation [105,299,490,653], including in aerosols [465,500].”
From Tackling climate change with machine learning (2023) · cites this paper as [653]
Citations
Cites
Cortes, C., & Vapnik, V. (1995) · Machine Learning · doi:10.1007/bf00994018 · Cited by 59,421
Cortes, C., & Vapnik, V. (1995) · Machine-mediated learning · doi:10.1023/a:1022627411411 · Cited by 48,445
LIBSVM: A library for support vector machines
Chang, C.-C., & Lin, C.-J. (2011) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/1961189.1961199 · Cited by 40,918 · cited 1×
“The SVM was implemented in WEKA 3.7 32,33 ; this implementation included a built-in data-normalization step.”
MethodInfluentialThe Elements of Statistical Learning
Hastie, T., Friedman, J., & Tibshirani, R. (2001) · Springer Series in Statistics · doi:10.1007/978-0-387-21606-5 · Cited by 24,162
The WEKA data mining software: an update
Hall, M., Frank, E., Holmes, G., Pfahringer, B., Reutemann, P., & Witten, I. H. (2009) · ACM SIGKDD Explorations Newsletter · doi:10.1145/1656274.1656278 · Cited by 17,750 · cited 2×
“All data were relabelled with the predicted outcomes of the SVM model and a C4.5 decision tree (implemented in WEKA 3.7) 32 was used to model those predicted outcomes 39 .”
MethodInfluentialThe Cambridge Structural Database: a quarter of a million crystal structures and rising
Allen, F. H. (2002) · Acta Crystallographica Section B Structural Science · doi:10.1107/s0108768102003890 · Cited by 9,898 · cited 2×
“Organically templated metal oxides using these diamines are essentially unknown, as indicated by their near absence from the Cambridge Structural Database 26 (see Methods).”
BackgroundText categorization with Support Vector Machines: Learning with many relevant features
Joachims, T. (1998) · Lecture Notes in Computer Science · doi:10.1007/bfb0026683 · Cited by 7,999
Introduction to Metal–Organic Frameworks
Zhou, H.-C., Long, J. R., & Yaghi, O. M. (2012) · Chemical Reviews · doi:10.1021/cr300014x · Cited by 7,720 · cited 1×
“Inorganic–organic hybrid materials 1–3 such as organically templated metal oxides 1 , metal–organic frameworks (MOFs) 2 and organohalide perovskites 4 have been studied for decades, and hydrothermal and (non-aqueous) solvothermal syntheses have produced thousands of new materials that collectively…”
BackgroundMetal-halide perovskites for photovoltaic and light-emitting devices
Stranks, S. D., & Snaith, H. J. (2015) · Nature Nanotechnology · doi:10.1038/nnano.2015.90 · Cited by 3,392 · cited 1×
“Inorganic–organic hybrid materials 1–3 such as organically templated metal oxides 1 , metal–organic frameworks (MOFs) 2 and organohalide perovskites 4 have been studied for decades, and hydrothermal and (non-aqueous) solvothermal syntheses have produced thousands of new materials that collectively…”
BackgroundOpen-Framework Inorganic Materials
Cheetham, A. K., Férey, G., & Loiseau, T. (1999) · Angewandte Chemie International Edition · doi:10.1002/(sici)1521-3773(19991115)38:22<3268::aid-anie3268>3.0.co;2-u · Cited by 2,426 · cited 1×
“…templated metal oxides 1 , metal–organic frameworks (MOFs) 2 and organohalide perovskites 4 have been studied for decades, and hydrothermal and (non-aqueous) solvothermal syntheses have produced thousands of new materials that collectively contain nearly all the metals in the periodic table 5–9 .”
Background
Cited by
Items 1,001–1,006 of 1,006
Kikugawa, G., Nishimura, Y., Shimoyama, K., Ohara, T., Okabe, T., & Ohuchi, F. S. (2019) · Chemical Physics Letters · doi:10.1016/j.cplett.2019.04.075 · Cited by 13
Kondo, M., Wathsala, H. D. P., Sako, M., Hanatani, Y., Ishikawa, K., Hara, S., Takaai, T., Washio, T., Takizawa, S., & Sasai, H. (2020) · Chemical Communications · doi:10.1039/d0cc90423f · Cited by 13
Xin, C., Song, B., Jin, G., Song, Y., & Pan, F. M. (2023) · Advanced Theory and Simulations · doi:10.1002/adts.202300475 · Cited by 14
Key requirements for advancing machine learning approaches in single entity electrochemistry
(2024) · doi:10.1016/j.coelec.2024.101526 · Cited by 10
The materials data ecosystem: Materials data science and its role in data-driven materials discovery
Yin, H.-Q., Jiang, X., Liu, G.-Q., Elder, S., Xu, B., Zheng, Q.-J., & Qu, X.-H. (2018) · Chinese Physics B · doi:10.1088/1674-1056/27/11/118101 · Cited by 6
“ups of materials data are listed in Table. 1. It should be noted that the data from both the intermediate stages and the non-optimized samples are collected due to their potential in materials design [11] and optimization of final properties. Table 1 Attributes of the computational, experimental and production data in…”
BackgroundA catalyst acceleration platform toward realizing the energy transition
(2022) · doi:10.1016/j.matt.2022.11.018 · Cited by 2
Metadata
- Authors
- Raccuglia, P., Elbert, K. C., Adler, P. D. F., Falk, C., Wenny, M. B., Mollo, A., Zeller, M., Friedler, S. A., Schrier, J., & Norquist, A. J.
- Affiliations
- Haverford College (US)
- Corresponding author
- Friedler, Sorelle A.
- Schrier, Joshua
- Norquist, Alexander J.
- ORCID
- Venue
- Nature
- Published
- 2016-05-04
- Volume
- 533
- Issue
- 7601
- Pages
- 73-76
- ISSN
- 0028-0836 (ISSN-L)
- 1476-4687
- OpenAlex
- W2347129741
- Cited by
- 1,727
- References
- 37
- Citations by year
- 2026: 215 · 2025: 225 · 2024: 214 · 2023: 169 · 2022: 201 · 2021: 206 · 2020: 190 · 2019: 148 · 2018: 95 · 2017: 51 · 2016: 13
- FWCI
- 45.53
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.springer.com/tdm (tdm)
- www.springer.com/tdm (vor)
- Locations
- Nature (publishedVersion)
- PubMed (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- Topics
- Physical Sciences › Materials Science › Materials Chemistry › Machine Learning in Materials Science
- Life Sciences › Pharmacology, Toxicology and Pharmaceutics › Drug Discovery › Computational Drug Discovery Methods
- Social Sciences › Arts and Humanities › History and Philosophy of Science › History and advancements in chemistry
- Keywords
- dark reaction, chemical reaction prediction, machine learning, hydrothermal synthesis, laboratory notebooks, cheminformatics, organic-inorganic hybrid materials, materials discovery, crystal structure prediction, synthetic route design, Materials Genome Initiative
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.