The DOI matches its Crossref record; 55 of the 55 references it cites were found in a registry or an index.
ChatGPT Chemistry Assistant for Text Mining and the Prediction of MOF Synthesis
Open accessAbstract
We use prompt engineering to guide ChatGPT in the automation of text mining of metal-organic framework (MOF) synthesis conditions from diverse formats and styles of the scientific literature. This effectively mitigates ChatGPT's tendency to hallucinate information, an issue that previously made the use of large language models (LLMs) in scientific fields challenging. Our approach involves the development of a workflow implementing three different processes for text mining, programmed by ChatGPT itself. All of them enable parsing, searching, filtering, classification, summarization, and data unification with different trade-offs among labor, speed, and accuracy. We deploy this system to extract 26 257 distinct synthesis parameters pertaining to approximately 800 MOFs sourced from peer-reviewed research articles. This process incorporates our ChemPrompt Engineering strategy to instruct ChatGPT in text mining, resulting in impressive precision, recall, and F1 scores of 90-99%. Furthermore, with the data set built by text mining, we constructed a machine-learning model with over 87% accuracy in predicting MOF experimental crystallization outcomes and preliminarily identifying important factors in MOF crystallization. We also developed a reliable data-grounded MOF chatbot to answer questions about chemical reactions and synthesis procedures. Given that the process of using ChatGPT reliably mines and tabulates diverse MOF synthesis information in a unified format while using only narrative language requiring no coding expertise, we anticipate that our ChatGPT Chemistry Assistant will be very useful across various other chemistry subdisciplines.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Shannon, R. D. (1976) · Acta Crystallographica Section A · doi:10.1107/s0567739476001551 · Cited by 66,145
Efficient Estimation of Word Representations in Vector Space
Mikolov, T., Chen, K., Corrado, G., & Dean, J. (2013) · arXiv · doi:10.48550/arxiv.1301.3781 · Cited by 26,568
CRC Handbook of Chemistry and Physics
(2016) · CRC Press eBooks · doi:10.1201/9781315380476 · Cited by 13,921
Reticular synthesis and the design of new materials
Yaghi, O. M., O'Keeffe, M., Ockwig, N. W., Chae, H. K., Eddaoudi, M., & Kim, J. (2003) · Nature · doi:10.1038/nature01650 · Cited by 9,101
Self-citationRandom Forest: A Classification and Regression Tool for Compound Classification and QSAR Modeling
Svetnik, V., Liaw, A., Tong, C., Culberson, J. C., Sheridan, R. P., & Feuston, B. P. (2003) · Journal of Chemical Information and Computer Sciences · doi:10.1021/ci034160g · Cited by 3,573
Automatic Chemical Design Using a Data-Driven Continuous Representation of Molecules
Gómez-Bombarelli, R., Wei, J. N., Duvenaud, D., Hernández-Lobato, J. M., Sánchez-Lengeling, B., Sheberla, D., Aguilera-Iparraguirre, J., Hirzel, T. D., Adams, R. P., & Aspuru-Guzik, A. (2018) · ACS Central Science · doi:10.1021/acscentsci.7b00572 · Cited by 3,106
Pauling, L. (1932) · Journal of the American Chemical Society · doi:10.1021/ja01348a011 · Cited by 1,870
Rowsell, J. L. C., & Yaghi, O. M. (2006) · Journal of the American Chemical Society · doi:10.1021/ja056639q · Cited by 1,841
Self-citationThe rise of deep learning in drug discovery
Chen, H., Engkvist, O., Wang, Y., Olivecrona, M., & Blaschke, T. (2018) · Drug Discovery Today · doi:10.1016/j.drudis.2018.01.039 · Cited by 1,770
Automatic Chemical Design Using a Data-Driven Continuous Representation of Molecules.
Gómez‐Bombarelli, R., Wei, J. N., Duvenaud, D., Hernández-Lobato, J. M., Sánchez-Lengeling, B., Sheberla, D., Aguilera‐Iparraguirre, J., Hirzel, T. D., Adams, R. P., & Aspuru‐Guzik, A. (2018) · Cambridge University Engineering Department Publications Database · doi:10.17863/cam.34134 · Cited by 1,703
Sparks of Artificial General Intelligence: Early experiments with GPT-4
Bubeck, S., Chandrasekaran, V., Eldan, R., Gehrke, J., Horvitz, E., Kamar, E., Lee, P., Lee, Y. T., Li, Y., Lundberg, S., et al. (2023) · arXiv · doi:10.48550/arxiv.2303.12712 · Cited by 1,526
Moghadam, P. Z., Li, A., Wiggin, S. B., Tao, A., Maloney, A. G. P., Wood, P. A., Ward, S. C., & Fairen-Jimenez, D. (2017) · Chemistry of Materials · doi:10.1021/acs.chemmater.7b00441 · Cited by 1,082
Predicting reaction performance in C–N cross-coupling using machine learning
Ahneman, D. T., Estrada, J. G., Lin, S., Dreher, S. D., & Doyle, A. G. (2018) · Science · doi:10.1126/science.aar5169 · Cited by 1,058
Chung, Y. G., Haldoupis, E., Bucior, B. J., Haranczyk, M., Lee, S., Zhang, H., Vogiatzis, K. D., Milisavljevic, M., Ling, S., Camp, J. S., et al. (2019) · Journal of Chemical & Engineering Data · doi:10.1021/acs.jced.9b00835 · Cited by 863
Chung, Y. G., Camp, J., Haranczyk, M., Sikora, B. J., Bury, W., Krungleviciute, V., Yildirim, T., Farha, O. K., Sholl, D. S., & Snurr, R. Q. (2014) · Chemistry of Materials · doi:10.1021/cm502594j · Cited by 743
Introduction to Reticular Chemistry: Metal‐Organic Frameworks and Covalent Organic Frameworks
Yaghi, O. M., Kalmutzki, M. J., & Diercks, C. S. (2019) · Wiley eBooks · doi:10.1002/9783527821099 · Cited by 701
Self-citationBloch, E. D., Murray, L. J., Queen, W. L., Chavan, S., Maximoff, S. N., Bigi, J. P., Krishna, R., Peterson, V. K., Grandjean, F., Long, G. J., et al. (2011) · Journal of the American Chemical Society · doi:10.1021/ja205976v · Cited by 531
The rise of intelligent matter
Kaspar, C., Ravoo, B. J., van der Wiel, W. G., Wegner, S. V., & Pernice, W. H. P. (2021) · Nature · doi:10.1038/s41586-021-03453-y · Cited by 526
High Methane Storage Capacity in Aluminum Metal–Organic Frameworks
Gándara, F., Furukawa, H., Lee, S., & Yaghi, O. M. (2014) · Journal of the American Chemical Society · doi:10.1021/ja501606h · Cited by 468
Self-citationReinsch, H., van der Veen, M. A., Gil, B., et al. (2012) · Chemistry of Materials · doi:10.1021/cm3025445 · Cited by 441
What ChatGPT means for universities: Perceptions of scholars and students
(2023) · Journal of Applied Learning & Teaching · doi:10.37074/jalt.2023.6.1.22 · Cited by 431
Liu, T.-F., Feng, D., Chen, Y.-P., Zou, L., Bosch, M., Yuan, S., Wei, Z., Fordham, S., Wang, K., & Zhou, H.-C. (2015) · Journal of the American Chemical Society · doi:10.1021/ja5111317 · Cited by 402
Furukawa, H., Go, Y. B., Ko, N., Park, Y. K., Uribe-Romo, F. J., Kim, J., O’Keeffe, M., & Yaghi, O. M. (2011) · Inorganic Chemistry · doi:10.1021/ic201376t · Cited by 379
Self-citationColón, Y. J., Gómez-Gualdrón, D. A., & Snurr, R. Q. (2017) · Crystal Growth & Design · doi:10.1021/acs.cgd.7b00848 · Cited by 321
A Machine Learning Approach to Zeolite Synthesis Enabled by Automatic Literature Data Extraction
Jensen, Z., Kim, E., Kwon, S., Gani, T. Z. H., Román-Leshkov, Y., Moliner, M., Corma, A., & Olivetti, E. (2019) · ACS Central Science · doi:10.1021/acscentsci.9b00193 · Cited by 282
MOF Synthesis Prediction Enabled by Automatic Data Mining and Machine Learning**
Luo, Y., Bag, S., Zaremba, O., Cierpka, A., Andreo, J., Wuttke, S., Friederich, P., & Tsotsalas, M. (2022) · Angewandte Chemie International Edition · doi:10.1002/anie.202200242 · Cited by 237
Random forest as one-class classifier and infrared spectroscopy for food adulteration detection
de Santana, F. B., Borges Neto, W., & Poppi, R. J. (2019) · Food Chemistry · doi:10.1016/j.foodchem.2019.04.073 · Cited by 203
Prediction of water stability of metal–organic frameworks using machine learning
Batra, R., Chen, C., Evans, T. G., Walton, K. S., & Ramprasad, R. (2020) · Nature Machine Intelligence · doi:10.1038/s42256-020-00249-z · Cited by 201
Nandy, A., Duan, C., & Kulik, H. J. (2021) · Journal of the American Chemical Society · doi:10.1021/jacs.1c07217 · Cited by 200
Torrisi, S. B., Carbone, M. R., Rohr, B. A., Montoya, J. H., Ha, Y., Yano, J., Suram, S. K., & Hung, L. (2020) · npj Computational Materials · doi:10.1038/s41524-020-00376-6 · Cited by 171
Lyu, H., Ji, Z., Wuttke, S., & Yaghi, O. M. (2020) · Chem · doi:10.1016/j.chempr.2020.08.008 · Cited by 171
Self-citationThe Matter Simulation (R)evolution
Aspuru‐Guzik, A., Lindh, R. H., & Reiher, M. (2018) · ACS Central Science · doi:10.1021/acscentsci.7b00550 · Cited by 152
Nandy, A., Terrones, G., Arunachalam, N., Duan, C., Kastner, D. W., & Kulik, H. J. (2022) · Scientific Data · doi:10.1038/s41597-022-01181-0 · Cited by 152
MOF Linker Extension Strategy for Enhanced Atmospheric Water Harvesting
Hanikel, N., Kurandina, D. V., Chheda, S. P., Zheng, Z., Rong, Z., Neumann, S. E., Sauer, J., Siepmann, J. I., Gagliardi, L., & Yaghi, O. M. (2023) · ACS Central Science · doi:10.1021/acscentsci.3c00018 · Cited by 131
Self-citationClassification of Organic Molecules by Molecular Quantum Numbers
Nguyen, K. T., Blum, L. C., van Deursen, R., & Reymond, J. (2009) · ChemMedChem · doi:10.1002/cmdc.200900317 · Cited by 120
Hu, Z., Pramanik, S., Tan, K., Zheng, C., Liu, W., Zhang, X., Chabal, Y. J., & Li, J. (2013) · Crystal Growth & Design · doi:10.1021/cg4012185 · Cited by 112
The role of chemistry in inventing a sustainable future
Matlin, S. A., Mehta, G., Hopf, H., & Krief, A. (2015) · Nature Chemistry · doi:10.1038/nchem.2389 · Cited by 107
DigiMOF: A Database of Metal–Organic Framework Synthesis Information Generated via Text Mining
Glasby, L. T., Gubsch, K., Bence, R., Oktavian, R., Isoko, K., Moosavi, S. M., Cordiner, J., Cole, J. C., & Moghadam, P. Z. (2023) · Chemistry of Materials · doi:10.1021/acs.chemmater.3c00788 · Cited by 103
Application of random forest based approaches to surface-enhanced Raman scattering data
Seifert, S. (2020) · Scientific Reports · doi:10.1038/s41598-020-62338-8 · Cited by 96
A database of ultrastable MOFs reassembled from stable fragments with machine learning models
Nandy, A., Yue, S., Oh, C., Duan, C., Terrones, G., Chung, Y. G., & Kulik, H. J. (2023) · Matter · doi:10.1016/j.matt.2023.03.009 · Cited by 95
Meyer, J. G., Liu, S., Miller, I. J., Coon, J. J., & Gitter, A. (2019) · Journal of Chemical Information and Modeling · doi:10.1021/acs.jcim.9b00236 · Cited by 92
Similarity of Precursors in Solid-State Synthesis as Text-Mined from Scientific Literature
He, T., Sun, W. Q., Huo, H., Kononova, O., Rong, Z., Tshitoyan, V., Botari, T., & Ceder, G. (2020) · Chemistry of Materials · doi:10.1021/acs.chemmater.0c02553 · Cited by 86
Mining Insights on Metal–Organic Framework Synthesis from Scientific Literature Texts
Park, H., Kang, Y., Choe, W., & Kim, J. (2022) · Journal of Chemical Information and Modeling · doi:10.1021/acs.jcim.1c01297 · Cited by 79
Text Mining Metal–Organic Framework Papers
Park, S., Kim, B., Choi, S., Boyd, P. G., Smit, B., & Kim, J. (2018) · Journal of Chemical Information and Modeling · doi:10.1021/acs.jcim.7b00608 · Cited by 69
Random forest classification for predicting lifespan-extending chemical compounds
Kapsiani, S., & Howlin, B. J. (2021) · Scientific Reports · doi:10.1038/s41598-021-93070-6 · Cited by 64
van Deursen, R., Blum, L. C., & Reymond, J. (2010) · Journal of Chemical Information and Modeling · doi:10.1021/ci100237q · Cited by 62
Solvent-Dependent Formation of Three New Bi-Metal–Organic Frameworks Using a Tetracarboxylic Acid
Köppen, M., Meyer, V., Ångström, J., Inge, A. K., & Stock, N. (2018) · Crystal Growth & Design · doi:10.1021/acs.cgd.8b00439 · Cited by 53
Green Synthesis and Scale-Up of MOFs for Water Harvesting from Air
Zheng, Z., Alawadhi, A. H., & Yaghi, O. M. (2023) · Molecular Frontiers Journal · doi:10.1142/s2529732523400011 · Cited by 49
Self-citationIs GPT-3 all you need for low-data discovery in chemistry?Preprint
Jablonka, K. M., Schwaller, P., Ortega‐Guerrero, A., & Smit, B. (2023) · ChemRxiv · doi:10.26434/chemrxiv-2023-fw8n4 · Cited by 35
The application of machine learning for predicting the methane uptake and working capacity of MOFs
Suyetin, M. V. (2021) · Faraday Discussions · doi:10.1039/d1fd00011j · Cited by 32
Li, M.-Y., Wang, F., & Zhang, J. (2020) · Crystal Growth & Design · doi:10.1021/acs.cgd.0c00258 · Cited by 31
Rajappan, R., Shingade, P., Natarajan, R., & Valadi, J. K. (2009) · Industrial & Engineering Chemistry Research · doi:10.1021/ie8018406 · Cited by 27
Franklin, E. B., Yee, L. D., Aumont, B., Weber, R. J., Grigas, P., & Goldstein, A. H. (2022) · Atmospheric measurement techniques · doi:10.5194/amt-15-3779-2022 · Cited by 22
Scaling Transformer to 1M tokens and beyond with RMT
Bulatov, A., Kuratov, Y., Kapushev, Y., & Burtsev, M. S. (2023) · arXiv · doi:10.48550/arxiv.2304.11062 · Cited by 19
Error Tolerance of Machine Learning Algorithms across Contemporary Biological Targets
Kaiser, T. M., & Burger, P. B. (2019) · Molecules · doi:10.3390/molecules24112115 · Cited by 18
Research works printed but not linked: 12
- Brown T., 2020, NIPS, 33, 1877
- Radford A., 2019, OpenAI blog, 1, 9
- Radford A., 2018, Preprint
- Le, Q.; Mikolov, T. In Distributed Representations of Sentences and Documents ; International Conference on Machine Learning, PMLR: 2014; pp 1188–1196.
- Mikolov T., 2013, NIPS, 26
- Kusner, M.; Sun, Y.; Kolkin, N.; Weinberger, K. From Word Embeddings to Document Distances ; International Conference on Machine Learning, PMLR: 2015; pp 957–966.
- 10.1021/jacs.1c11836 · doi:10.1021/jacs.1c11836
- 10.1002/ijch.202300017 · doi:10.1002/ijch.202300017
- Ho, T. K. Random Decision Forests ; Proceedings of 3rd International Conference on Document Analysis and Recognition, IEEE: 1995; pp 278–282.
- 10.5772/intechopen.90435 · doi:10.5772/intechopen.90435
- 10.1021/acs.chemmater.2c03288 · doi:10.1021/acs.chemmater.2c03288
- Dao, T.; Fu, D.; Ermon, S.; Rudra, A.; Ré, C. Flashattention: Fast and memory-efficient exact attention with io-awareness. NIPS 2022; Vol. 35, pp 16344–16359.
Cited by
Structured information extraction from scientific text with large language models
Dagdelen, J., Dunn, A., Lee, S., Walker, N., Rosen, A. S., Ceder, G., Persson, K. A., & Jain, A. (2024) · Nature Communications · doi:10.1038/s41467-024-45563-x · Cited by 771
Structural Design for EMI Shielding: From Underlying Mechanisms to Common Pitfalls
Isari, A. A., Ghaffarkhah, A., Hashemi, S. A., Wuttke, S., & Arjmand, M. (2024) · Advanced Materials · doi:10.1002/adma.202310683 · Cited by 436
Metal–phenolic network composites: from fundamentals to applications
Lin, Z., Liu, H., Richardson, J. J., Xu, W., Chen, J., Zhou, J., & Caruso, F. (2024) · Chemical Society Reviews · doi:10.1039/d3cs00273j · Cited by 283
A review of large language models and autonomous agents in chemistry
Ramos, M. C., Collison, C. J., & White, A. D. (2025) · Chemical Science · doi:10.1039/d4sc03921a · Cited by 274
ChatGPT Research Group for Optimizing the Crystallinity of MOFs and COFs
Zheng, Z., Zhang, O., Nguyen, H. L., Rampal, N., Alawadhi, A. H., Rong, Z., Head-Gordon, T., Borgs, C., Chayes, J. T., & Yaghi, O. M. (2023) · ACS Central Science · doi:10.1021/acscentsci.3c01087 · Cited by 172
Self-citation
Metadata
- Authors
- Zheng, Z., Zhang, O., Borgs, C., Chayes, J. T., & Yaghi, O. M.
- Venue
- Journal of the American Chemical Society
- Publisher
- American Chemical Society (ACS)
- Published
- 2023-08-07
- Volume
- 145
- Issue
- 32
- Pages
- 18048-18062
- ISSN
- 0002-7863 (ISSN-L)
- 1520-5126
- OpenAlex
- W4385027818
- Cited by
- 536
- References
- 55
- FWCI
- 37.71
- Type
- journal article
- Language
- en
- Open access
- green
- Licence
- Funders
- Defense Advanced Research Projects Agency (HR0011-21-C-0020)
- National Institute of General Medical Sciences (5R01GM127627-04)
- Kavli Foundation
- Bakar Institute of Digital Materials for the Planet
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.