Empowering Molecule Discovery for Molecule-Caption Translation With Large Language Models: A ChatGPT Perspective
Open accessThe DOI matches its Crossref record; 15 of the 15 references it cites were found in a registry or an index.
Abstract
Molecule discovery plays a crucial role in various scientific fields, advancing the design of tailored materials and drugs, which contributes to the development of society and human well-being. Specifically, molecule-caption translation is an important task for molecule discovery, aligning human understanding with molecular space. However, most of the existing methods heavily rely on domain experts, require excessive computational cost, or suffer from sub-optimal performance. On the other hand, Large Language Models (LLMs), like ChatGPT, have shown remarkable performance in various cross-modal tasks due to their powerful capabilities in natural language understanding, generalization, and in-context learning (ICL), which provides unprecedented opportunities to advance molecule discovery. Despite several previous works trying to apply LLMs in this task, the lack of domain-specific corpus and difficulties in training specialized LLMs still remain challenges. In this work, we propose a novel LLM-based framework (MolReGPT) for molecule-caption translation, where an In-Context Few-Shot Molecule Learning paradigm is introduced to empower molecule discovery with LLMs like ChatGPT to perform their in-context learning capability without domain-specific pre-training and fine-tuning. MolReGPT leverages the principle of molecular similarity to retrieve similar molecules and their text descriptions from a local database to enable LLMs to learn the task knowledge from context examples. We evaluate the effectiveness of MolReGPT on molecule-caption translation, including molecule understanding and text-based molecule generation. Experimental results show that compared to fine-tuned models, MolReGPT outperforms MolT5-base and is comparable to MolT5-large without additional training. To the best of our knowledge, MolReGPT is the first work to leverage LLMs via in-context learning in molecule-caption translation for advancing molecule discovery. Our work expands the scope of LLM applications, as well as providing a new paradigm for molecule discovery and design.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer
Raffel, C., Shazeer, N., Roberts, A., Lee, K., Narang, S., Matena, M., Zhou, Y., Li, W., & Liu, P. J. (2019) · arXiv · doi:10.48550/arxiv.1910.10683 · Cited by 10,929
Weininger, D. (1988) · Journal of Chemical Information and Computer Sciences · doi:10.1021/ci00057a005 · Cited by 7,436 · cited 1×
“Specifically, molecules can be represented as simplified molecular-input line-entry system ( SMILES ) strings [6], illustrated in Fig.”
BackgroundLLaMA: Open and Efficient Foundation Language Models
Touvron, H., Lavril, T., Izacard, G., Martinet, X., Lachaux, M.-A., Lacroix, T., Rozière, B., Goyal, N., Hambro, E., Azhar, F., et al. (2023) · arXiv · doi:10.48550/arxiv.2302.13971 · Cited by 4,602
Training language models to follow instructions with human feedback
Ouyang, L., Wu, J., Jiang, X., Almeida, D., Wainwright, C. L., Mishkin, P., Zhang, C., Agarwal, S., Slama, K., Ray, A., et al. (2022) · arXiv · doi:10.48550/arxiv.2203.02155 · Cited by 4,208
Training Language Models to Follow Instructions with Human Feedback
Ouyang, L., Wu, J., Jiang, X., Almeida, D., Wainwright, C., Mishkin, P., Zhang, C., Agarwal, S., Slama, K., Ray, A., et al. (2022) · Advances in Neural Information Processing Systems 35 · doi:10.52202/068431-2011 · Cited by 3,117
PaLM: Scaling Language Modeling with Pathways
Chowdhery, A., Narang, S., Devlin, J., Bosma, M., Mishra, G., Roberts, A., Barham, P., Chung, H. W., Sutton, C., Gehrmann, S., et al. (2022) · arXiv · doi:10.48550/arxiv.2204.02311 · Cited by 2,590
An information-theoretic perspective of tf–idf measures
Aizawa, A. (2003) · Information Processing & Management · doi:10.1016/s0306-4573(02)00021-3 · Cited by 1,419
Augmenting large language models with chemistry tools
M. Bran, A., Cox, S., Schilter, O., Baldassari, C., White, A. D., & Schwaller, P. (2024) · Nature Machine Intelligence · doi:10.1038/s42256-024-00832-8 · Cited by 794
LaMDA: Language Models for Dialog Applications
Thoppilan, R., De Freitas, D., Hall, J., Shazeer, N., Kulshreshtha, A., Cheng, H.-T., Jin, A., Bos, T., Baker, L., Du, Y., et al. (2022) · arXiv · doi:10.48550/arxiv.2201.08239 · Cited by 778 · cited 1×
“Inaddition,otherLLMs,such asLaMDA[29],PaLM[30],andVicuna[31],alsoshowadecent performance.”
MiniGPT-4: Enhancing Vision-Language Understanding with Advanced Large Language Models
Zhu, D., Chen, J., Shen, X., Li, X., & Elhoseiny, M. (2023) · arXiv · doi:10.48550/arxiv.2304.10592 · Cited by 469
Research works printed but not linked: 26
- 10.1016/j.ijbiomac.2023.123257 · DOI
- 10.1021/acs.orglett.1c00609 · DOI
- 10.1002/ejoc.201901572 · doi:10.1002/ejoc.201901572
- 10.1080/15583724.2022.2106490 · DOI
- 10.1016/j.ailsci.2022.100031 · DOI
- 10.1186/s13321-019-0393-0 · DOI · Paper page
- 10.18653/v1/2021.emnlp-main.47 · DOI · Paper page
- Edwards, Translation between molecules and natural language, 375
- 10.1109/TAI.2023.3251977 · DOI
- 10.1021/acs.jcim.9b00732 · DOI
- 10.1016/j.ab.2019.03.017 · DOI
- 10.1021/acs.jcim.9b00943 · DOI · Paper page
- 10.1021/acs.jcim.0c00343 · DOI
- 10.1021/acs.jcim.1c00600 · DOI · Paper page
- 10.1038/s42256-021-00403-1 · DOI · Paper page
- 10.1038/s41467-022-28494-3 · DOI
- Radford, 2018, Improving language understanding by generative pre-training, OpenAI
- Radford, 2019, Language models are unsupervised multitask learners, OpenAI Blog, 1
- 10.1038/s41570-023-00502-0 · DOI
- 10.1038/s42256-023-00759-6 · DOI · Paper page
- 10.1186/s13321-016-0130-x · DOI · Paper page
- 10.1021/ci9803381 · DOI · Paper page
- 10.1561/1500000019 · DOI · Paper page
- 10.2307/1932409.JSTOR1932409 · doi:10.2307/1932409.jstor1932409
- 10.1186/s13321-022-00595-7 · DOI
- Vaswani, Attention is all you need
Cited by
Recommender Systems in the Era of Large Language Models (LLMs)
Zhao, Z., Fan, W., Li, J., Liu, Y., Mei, X., Wang, Y., Wen, Z., Wang, F., Zhao, X., Tang, J., et al. (2024) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2024.3392335 · Cited by 481
“With the powerful abilities mentioned above, LLMs have shown remarkable potential in various fields, such as chemistry [15], education [53], and finance [54].”
Self-citationJablonka, K. M., Ai, Q., Al-Feghali, A., Badhwar, S., Bocarsly, J. D., Bran, A. M., Bringuier, S., Brinson, L. C., Choudhary, K., Circi, D., et al. (2023) · Digital Discovery · doi:10.1039/d3dd00113j · Cited by 218
Exploring the Potential of Large Language Models (LLMs)in Learning on Graphs
Chen, Z., Mao, H., Li, H., Jin, W., Wen, H., Wei, X., Wang, S., Yin, D., Fan, W., Liu, H., et al. (2024) · ACM SIGKDD Explorations Newsletter · doi:10.1145/3655103.3655110 · Cited by 209
“Following our proposed two pipelines, i.e., LLMs as the En-hancers and LLMs as the Predictors, we review existing works in this section.”
MethodSelf-citationA Multiagent-Driven Robotic AI Chemist Enabling Autonomous Chemical Research On Demand
Song, T., Luo, M., Zhang, X., Chen, L., Huang, Y., Cao, J., Zhu, Q., Liu, D., Zhang, B., Zou, G., et al. (2025) · Journal of the American Chemical Society · doi:10.1021/jacs.4c17738 · Cited by 171
Accelerated end-to-end chemical synthesis development with large language models
Ruan, Y., Lu, C., Xu, N., Zhang, J., Xuan, J., Pan, J., Fang, Q., Gao, H., Shen, X., Ye, N., et al. (2024) · doi:10.26434/chemrxiv-2024-6wmg4 · Cited by 140
Metadata
- Authors
- Li, J., Liu, Y., Fan, W., Wei, X.-Y., Liu, H., Tang, J., & Li, Q.
- Venue
- IEEE Transactions on Knowledge and Data Engineering
- Published
- 2024-11
- Volume
- 36
- Issue
- 11
- Pages
- 6071-6083
- ISSN
- 1041-4347 (ISSN-L)
- 1558-2191
- 2326-3865
- OpenAlex
- W4396597709
- Cited by
- 83
- References
- 15
- FWCI
- 15.88
- Type
- journal article
- Language
- en
- Open access
- green
- Licence
- Funders
- National Natural Science Foundation of China (62102335)
- General Research Funds
- Hong Kong Research Grants Council (PolyU 15200021, 15207322, 15200023)
- Hong Kong Polytechnic University (P0036200, P0042693, P0048625, P0048752)
- Research Collaborative (P0041282)
- SHTM Interdisciplinary Large (P0043302)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Empowering Molecule Discovery for Molecule-Caption Translation With Large Language Models: A ChatGPT Perspective. https://app.cochat.ai/papers/10.1109/tkde.2024.3393356
- The paper
- Li, J., Liu, Y., Fan, W., Wei, X.-Y., Liu, H., Tang, J., & Li, Q. (2024). Empowering Molecule Discovery for Molecule-Caption Translation With Large Language Models: A ChatGPT Perspective. IEEE Transactions on Knowledge and Data Engineering. https://doi.org/10.1109/tkde.2024.3393356
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.