Student or educator? Sign up with your school email and get 6 months of Pro free.
Cited by 236

The DOI matches its Crossref record; 23 of the 23 references it cites were found in a registry or an index.

ChatMOF: an artificial intelligence system for predicting and generating metal-organic frameworks using large language models

Open access
Kang, Yeonghun, Kim, Jihan·2024·Nature Communications

Abstract

ChatMOF is an artificial intelligence (AI) system that is built to predict and generate metal-organic frameworks (MOFs). By leveraging a large-scale language model (GPT-4, GPT-3.5-turbo, and GPT-3.5-turbo-16k), ChatMOF extracts key details from textual inputs and delivers appropriate responses, thus eliminating the necessity for rigid and formal structured queries. The system is comprised of three core components (i.e., an agent, a toolkit, and an evaluator) and it forms a robust pipeline that manages a variety of tasks, including data retrieval, property prediction, and structure generations. ChatMOF shows high accuracy rates of 96.9% for searching, 95.7% for predicting, and 87.5% for generating tasks with GPT-4. Additionally, it successfully creates materials with user-desired properties from natural language. The study further explores the merits and constraints of utilizing large language models (LLMs) in combination with database and machine learning in material sciences and showcases its transformative potential for future advancements.

Overview

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1038/s41467-024-48998-4

Cites

23 of 23 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 23 references

Research works printed but not linked: 57

  1. Kenton, J. D. M.-W. C. & Toutanova, L. K. Bert: Pre-training of deep bidirectional transformers for language understanding. in Proceedings of naacL-HLT (2019).
  2. Vaswani, A. et al. Attention is all you need. Advances in Neural Information Processing Systems 30, (2017).
  3. Khan, R. A., Jawaid, M., Khan, A. R. & Sajjad, M. ChatGPT-Reshaping medical education and clinical management. Pak. J. Med. Sci. 39, 605 (2023). · DOI · Paper page
  4. Hendrycks, D. et al. Aligning AI with shared human values. in International Conference on Learning Representations (2021).
  5. Hendrycks, D. et al. Measuring massive multitask language understanding. in International Conference on Learning Representations (2021).
  6. Zheng, Z., Zhang, O., Borgs, C., Chayes, J. T. & Yaghi, O. M. ChatGPT chemistry assistant for text mining and prediction of MOF synthesis. J. Am. Chem. Soc. 145, 18048–18062 (2023). · DOI · Paper page
  7. Wei, J. et al. Finetuned language models are zero-shot learners. in International Conference on Learning Representations (2022).
  8. Dagdelen, J. et al. Structured information extraction from scientific text with large language models. Nat. Commun. 15, 1418 (2024). · DOI · Paper page
  9. Wu, Q. et al. Autogen: enabling next-gen llm applications via multi-agent conversation framework. Preprint at https://arxiv.org/abs/2308.08155 (2023). · arXiv
  10. Guo, T. et al. What can large language models do in chemistry? a comprehensive benchmark on eight tasks. Adv. Neural. Inf. Process. Syst. 36, 59662–59688 (2023).
  11. White, A. D. et al. Assessment of chemistry knowledge in large language models that generate code. Digit. Discov. 2, 368–376 (2023). · DOI
  12. Bran, A. M. & Schwaller, P. Transformers and large language models for chemistry and drug discovery. Preprint at https://arxiv.org/abs/2310.06083 (2023). · arXiv
  13. Waisberg, E. et al. GPT-4: a new era of artificial intelligence in medicine. Ir. J. Med. Sci. (1971-) 192, 3197-3200 (2023). · DOI · Paper page
  14. Wang, Y., Zhao, Y. & Petzold, L. Are large language models ready for healthcare? a comparative study on clinical language understanding. In Machine Learning for Healthcare Conference (2023).
  15. Bucior, B. J. et al. Identification schemes for metal–organic frameworks to enable rapid search and cheminformatics analysis. Cryst. Growth Des. 19, 6682–6697 (2019). · DOI · Paper page
  16. Hu, T., Song, H., Jiang, T. & Li, S. Learning representations of inorganic materials from generative adversarial networks. Symmetry 12, 1889 (2020). · DOI
  17. Ward, L., Agrawal, A., Choudhary, A. & Wolverton, C. A general-purpose machine learning framework for predicting properties of inorganic materials. npj Comput. Mater. 2, 1–7 (2016). · DOI · Paper page
  18. Calfa, B. A. & Kitchin, J. R. Property prediction of crystalline solids from composition and crystal structure. AIChE J. 62, 2605–2613 (2016). · DOI
  19. James, S. L. Metal-organic frameworks. Chem. Soc. Rev. 32, 276–288 (2003). · DOI · Paper page
  20. Kitagawa, S. Metal–organic frameworks (MOFs). Chem. Soc. Rev. 43, 5415–5418 (2014). · DOI · Paper page
  21. Zhou, H.-C., Long, J. R. & Yaghi, O. M. Introduction to metal–organic frameworks. Chem. Rev. 112, 673–674 (2012). · DOI · Paper page
  22. Freund, R. et al. The current status of MOF and COF applications. Angew. Chem. Int. Ed. 60, 23975–24001 (2021). · DOI · Paper page
  23. Kumar, S. et al. Green synthesis of metal–organic frameworks: a state-of-the-art review of potential environmental and medical applications. Coord. Chem. Rev. 420, 213407 (2020). · DOI · Paper page
  24. Qian, Q. et al. MOF-based membranes for gas separations. Chem. Rev. 120, 8161–8266 (2020). · DOI · Paper page
  25. Zhang, X. et al. A historical overview of the activation and porosity of metal–organic frameworks. Chem. Soc. Rev. 49, 7406–7427 (2020). · DOI · Paper page
  26. Deng, H. et al. Large-pore apertures in a series of metal-organic frameworks. Science 336, 1018–1023 (2012). · DOI · Paper page
  27. Furukawa, H., Cordova, K. E., O’Keeffe, M. & Yaghi, O. M. The chemistry and applications of metal-organic frameworks. Science 341, 1230444 (2013). · DOI · Paper page
  28. Wang, C., Liu, D. & Lin, W. Metal–organic frameworks as a tunable platform for designing functional molecular materials. J. Am. Chem. Soc. 135, 13222–13234 (2013). · DOI · Paper page
  29. Liu, Y. et al. Data quantity governance for machine learning in materials science. Natl. Sci. Rev. 10, nwad125 (2023). · DOI · Paper page
  30. Yao, S. et al. Tree of thoughts: Deliberate problem solving with large language models. in Thirty-seventh Conference on Neural Information Processing Systems (2023).
  31. Yao, S. et al. ReAct: Synergizing reasoning and acting in language models. in The Eleventh International Conference on Learning Representations (2022).
  32. Chung, Y. G. et al. Computation-ready, experimental metal–organic frameworks: A tool to enable high-throughput screening of nanoporous crystals. Chem. Mater. 26, 6185–6192 (2014). · DOI · Paper page
  33. Rosen, A. S. et al. Machine learning the quantum-chemical properties of metal–organic frameworks for accelerated materials discovery. Matter 4, 1578–1597 (2021). · DOI · Paper page
  34. Moghadam, P. Z. et al. Development of a Cambridge Structural Database subset: a collection of metal–organic frameworks for past, present, and future. Chem. Mater. 29, 2618–2625 (2017). · DOI · Paper page
  35. McKinney, W. pandas: a foundational Python library for data analysis and statistics. Python high. Perform. Sci. Comput. 14, 1–9 (2011).
  36. Glasby, L. T. et al. DigiMOF: a database of metal–organic framework synthesis information generated via text mining. Chem. Mater 35, 4510–4524 (2023). · DOI
  37. Altintas, C., Altundal, O. F., Keskin, S. & Yildirim, R. Machine learning meets with metal organic frameworks for gas storage and separation. J. Chem. Inf. Model. 61, 2131–2146 (2021). · DOI · Paper page
  38. Kang, Y., Park, H., Smit, B. & Kim, J. A multi-modal pre-training transformer for universal transfer learning in metal–organic frameworks. Nat. Mach. Intell. 5, 309–318 (2023). · DOI · Paper page
  39. Park, H., Kang, Y. & Kim, J. Enhancing structure–property relationships in porous materials through transfer learning and cross-material few-shot learning. ACS Appl. Mater. Interfaces 15, 56375–56385 (2023). · DOI
  40. Kim, B., Lee, S. & Kim, J. Inverse design of porous materials using artificial neural networks. Sci. Adv. 6, eaax9324 (2020). · DOI · Paper page
  41. Long, T. et al. Constrained crystals deep convolutional generative adversarial network for the inverse design of crystal structures. npj Comput. Mater. 7, 66 (2021). · DOI
  42. Xie, T., Fu, X., Ganea, O.-E., Barzilay, R. & Jaakkola, T. Crystal diffusion variational autoencoder for periodic material generation. In ICLR 2022 Poster https://openreview.net/forum?id=03RLpj-tc_ (2022).
  43. Lee, S. et al. Computational screening of trillions of metal–organic frameworks for high-performance methane storage. ACS Appl. Mater. Interfaces 13, 23647–23654 (2021). · DOI · Paper page
  44. Lim, Y., Park, J., Lee, S. & Kim, J. Finely tuned inverse design of metal–organic frameworks with user-desired Xe/Kr selectivity. J. Mater. Chem. A 9, 21175–21183 (2021). · DOI
  45. Park, J., Lim, Y., Lee, S. & Kim, J. Computational design of metal–organic frameworks with unprecedented high hydrogen working capacity and high synthesizability. Chem. Mater. 35, 9–16 (2022). · DOI
  46. Yao, Z. et al. Inverse design of nanoporous crystalline reticular materials with deep generative models. Nat. Mach. Intell. 3, 76–86 (2021). · DOI · Paper page
  47. Park, H., Majumdar, S., Zhang, X., Kim, J. & Smit, B. Inverse design of metal–organic frameworks for direct air capture of CO2 via deep reinforcement learning. Digital Discovery 3, 728–741 (2024). · DOI
  48. Larsen, A. H. et al. The atomic simulation environment—a Python library for working with atoms. J. Phys.: Condens. Matter 29, 273002 (2017).
  49. Willems, T. F., Rycroft, C. H., Kazi, M., Meza, J. C. & Haranczyk, M. Algorithms and tools for high-throughput geometry-based analysis of crystalline porous materials. Microporous Mesoporous Mater. 149, 134–141 (2012). · DOI · Paper page
  50. Gu, J. et al. A systematic survey of prompt engineering on vision-language foundation models. in CoRR (2023).
  51. White, J. et al. A prompt pattern catalog to enhance prompt engineering with chatgpt. in CoRR (2023).
  52. Orhan, I. B., Daglar, H., Keskin, S., Le, T. C. & Babarao, R. Prediction of O2/N2 selectivity in metal–organic frameworks via high-throughput computational screening and machine learning. ACS Appl. Mater. Interfaces 14, 736–749 (2021). · DOI
  53. Moosavi, S. M. et al. Understanding the diversity of the metal-organic framework ecosystem. Nat. Commun. 11, 1–10 (2020). · DOI · Paper page
  54. Nandy, A. et al. MOFSimplify, machine learning models with extracted stability data of three thousand metal–organic frameworks. Sci. Data 9, 74 (2022). · DOI
  55. Rappé, A. K., Casewit, C. J., Colwell, K., Goddard, W. A. III & Skiff, W. M. UFF, a full periodic table force field for molecular mechanics and molecular dynamics simulations. J. Am. Chem. Soc. 114, 10024–10035 (1992). · DOI · Paper page
  56. Dubbeldam, D., Calero, S., Ellis, D. E. & Snurr, R. Q. RASPA: molecular simulation software for adsorption and diffusion in flexible nanoporous materials. Mol. Simul. 42, 81–101 (2016). · DOI · Paper page
  57. Fischer, M., Hoffmann, F. & Fröba, M. Preferred hydrogen adsorption sites in various MOFs—a comparative computational study. ChemPhysChem 10, 2647–2657 (2009). · doi:10.1002/cphc.200900459

Cited by

See all 236

Metadata

Authors
Kang, Y., & Kim, J.
Venue
Nature Communications
Published
2024-06-03
Volume
15
Issue
1
Pages
4705-4705
ISSN
2041-1723 (ISSN-L)
OpenAlex
W4399290669
Cited by
236
References
23
FWCI
22.21
Type
journal article
Language
en
Open access
gold
Licence
Funders
  • National Research Foundation of Korea (2021R1A2C2003583, 2021M3A7C208974513)
  • National Supercomputing Center with supercomputing resources including technical support

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: ChatMOF: an artificial intelligence system for predicting and generating metal-organic frameworks using large language models. https://app.cochat.ai/papers/10.1038/s41467-024-48998-4
The paper
Kang, Y., & Kim, J. (2024). ChatMOF: an artificial intelligence system for predicting and generating metal-organic frameworks using large language models. Nature Communications. https://doi.org/10.1038/s41467-024-48998-4

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.