ChatExosome: An Artificial Intelligence (AI) Agent Based on Deep Learning of Exosomes Spectroscopy for Hepatocellular Carcinoma (HCC) Diagnosis
The DOI matches its Crossref record; 43 of the 43 references it cites were found in a registry or an index.
Abstract
Large language models (LLMs) hold significant promise in the field of medical diagnosis. There are still many challenges in the direct diagnosis of hepatocellular carcinoma (HCC). α-Fetoprotein (AFP) is a commonly used tumor marker for liver cancer. However, relying on AFP can result in missed diagnoses of HCC. We developed an artificial intelligence (AI) agent centered on LLMs, named ChatExosome, which created an interactive and convenient system for clinical spectroscopic analysis and diagnosis. ChatExosome consists of two main components: the first is the deep learning of the Raman fingerprinting of exosomes derived from HCC. Based on a patch-based 1D self-attention mechanism and downsampling, the feature fusion transformer (FFT) was designed to process the Raman spectra of exosomes. It achieved accuracies of 95.8% for cell-derived exosomes and 94.1% for 165 clinical samples, respectively. The second component is the interactive chat agent based on LLM. The retrieval-augmented generation (RAG) method was utilized to enhance the knowledge related to exosomes. Overall, LLM serves as the core of this interactive system, which is capable of identifying users' intentions and invoking the appropriate plugins to process the Raman data of exosomes. This is the first AI agent focusing on exosome spectroscopy and diagnosis, enhancing the interpretability of classification results, enabling physicians to leverage cutting-edge medical research and artificial intelligence techniques to optimize medical decision-making processes, and it shows great potential in intelligent diagnosis.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404
U-Net: Convolutional Networks for Biomedical Image Segmentation
Ronneberger, O., Fischer, P., & Brox, T. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-24574-4_28 · Cited by 99,404
Exploiting Generative AI to Scale up Intelligent Tutoring Systems
Jakubův, J., Chvalovský, K., Goertzel, Z., Kaliszyk, C., Olšák, M., Piotrowski, B., Schulz, S., Suda, M., & Urban, J. (2023) · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · doi:10.4230/lipics.itp.2023.19 · Cited by 76,658
An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale
Dosovitskiy, A., Beyer, L., Kolesnikov, A., Weissenborn, D., Zhai, X., Unterthiner, T., Dehghani, M., Minderer, M., Heigold, G., Gelly, S., et al. (2020) · arXiv · doi:10.48550/arxiv.2010.11929 · Cited by 47,472
Swin Transformer: Hierarchical Vision Transformer using Shifted Windows
Liu, Z., Lin, Y., Cao, Y., Hu, H., Wei, Y., Zhang, Z., Lin, S., & Guo, B. (2021) · arXiv · Cited by 35,608
Swin Transformer: Hierarchical Vision Transformer using Shifted Windows
Liu, Z., Lin, Y., Cao, Y., Hu, H., Wei, Y., Zhang, Z., Lin, S., & Guo, B. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00986 · Cited by 35,534
Bray, F., Laversanne, M., Sung, H., Ferlay, J., Siegel, R. L., Soerjomataram, I., & Jemal, A. (2024) · CA: a cancer journal for clinicians · doi:10.3322/caac.21834 · Cited by 27,064
Large language models encode clinical knowledge
Singhal, K., Azizi, S., Tu, T., Mahdavi, S. S., Wei, J., Chung, H. W., Scales, N., Tanwani, A., Cole-Lewis, H., Pfohl, S., et al. (2023) · Nature · doi:10.1038/s41586-023-06291-2 · Cited by 4,083
Large Language Models Encode Clinical Knowledge
Singhal, K., Azizi, S., Tu, T., Mahdavi, S. S., Wei, J., Chung, H. W., Scales, N., Tanwani, A., Cole-Lewis, H., Pfohl, S., et al. (2022) · arXiv · doi:10.48550/arxiv.2212.13138 · Cited by 4,083
Swin Transformer V2: Scaling Up Capacity and Resolution
Liu, Z., Hu, H., Lin, Y., Yao, Z., Xie, Z., Wei, Y., Ning, J., Cao, Y., Zhang, Z., Dong, L., et al. (2021) · arXiv · doi:10.48550/arxiv.2111.09883 · Cited by 2,679
Swin Transformer V2: Scaling Up Capacity and Resolution
Liu, Z., Hu, H., Lin, Y., Yao, Z., Xie, Z., Wei, Y., Ning, J., Cao, Y., Zhang, Z., Dong, L., et al. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01170 · Cited by 2,484
Foundation models for generalist medical artificial intelligence
Moor, M., Banerjee, O., Abad, Z. S. H., Krumholz, H. M., Leskovec, J., Topol, E. J., & Rajpurkar, P. (2023) · Nature · doi:10.1038/s41586-023-05881-4 · Cited by 2,028
Benefits, Limits, and Risks of GPT-4 as an AI Chatbot for Medicine
Lee, P., Bubeck, S., & Petro, J. (2023) · New England Journal of Medicine · doi:10.1056/nejmsr2214184 · Cited by 1,738
Retrieval-Augmented Generation for Large Language Models: A Survey
Gao, Y., Xiong, Y., Gao, X., Jia, K., Pan, J., Bi, Y., Dai, Y., Sun, J., Wang, M., & Wang, H. (2023) · arXiv · doi:10.48550/arxiv.2312.10997 · Cited by 876
Rapid identification of pathogenic bacteria using Raman spectroscopy and deep learning
Ho, C.-S., Jean, N., Hogan, C. A., Blackmon, L., Jeffrey, S. S., Holodniy, M., Banaei, N., Saleh, A. A. E., Ermon, S., & Dionne, J. (2019) · Nature Communications · doi:10.1038/s41467-019-12898-9 · Cited by 871
Exosome-based liquid biopsies in cancer: opportunities and challenges
Yu, W., Hurley, J., Roberts, D., Chakrabortty, S. K., Enderle, D., Noerholm, M., Breakefield, X. O., & Skog, J. K. (2021) · Annals of Oncology · doi:10.1016/j.annonc.2021.01.074 · Cited by 870
Exosomes as a new frontier of cancer liquid biopsy
Yu, D., Li, Y., Wang, M., Gu, J., Xu, W., Cai, H., Fang, X., & Zhang, X. (2022) · Molecular Cancer · doi:10.1186/s12943-022-01509-9 · Cited by 855
The metabolic profile of tumors depends on both the responsible genetic lesion and tissue type
Yuneva, M. O., Fan, T. W. M., Allen, T. D., Higashi, R. M., Ferraris, D. V., Tsukamoto, T., Matés, J. M., Alonso, F. J., Wang, C., Seo, Y., et al. (2012) · Cell Metabolism · doi:10.1016/j.cmet.2011.12.015 · Cited by 639
Shin, H., Oh, S., Hong, S., Kang, M., Kang, D., Ji, Y.-G., Choi, B. H., Kang, K.-W., Jeong, H., Park, Y., et al. (2020) · ACS Nano · doi:10.1021/acsnano.9b09119 · Cited by 506
Biomarkers in Hepatocellular Carcinoma: Diagnosis, Prognosis and Treatment Response Assessment
Piñero, F., Dirchwolf, M., & Pessôa, M. G. (2020) · Cells · doi:10.3390/cells9061370 · Cited by 498
Single test-based diagnosis of multiple cancer types using Exosome-SERS-AI for early stage cancers
Shin, H., Choi, B. H., Shim, O., Kim, J., Park, Y., Cho, S. K., Kim, H. K., & Choi, Y. (2023) · Nature Communications · doi:10.1038/s41467-023-37403-1 · Cited by 402
Feature Pyramid Networks for Object Detection
Lin, T.-Y., Dollár, P., Girshick, R., He, K., Hariharan, B., & Belongie, S. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1612.03144 · Cited by 380
A critical assessment of using ChatGPT for extracting structured data from clinical notes
Huang, J., Yang, D. M., Rong, R., Nezafati, K., Treager, C., Chi, Z., Wang, S., Cheng, X., Guo, Y., Klesse, L. J., et al. (2024) · npj Digital Medicine · doi:10.1038/s41746-024-01079-8 · Cited by 298
Lam, S. M., Zhang, C., Wang, Z., Ni, Z., Zhang, S., Yang, S., Huang, X., Mo, L., Li, J., Lee, B., et al. (2021) · Nature Metabolism · doi:10.1038/s42255-021-00425-4 · Cited by 284
Huang, L., Sun, H., Sun, L., Shi, K., Chen, Y., Ren, X., Ge, Y., Jiang, D., Liu, X., Knoll, W., et al. (2023) · Nature Communications · doi:10.1038/s41467-022-35696-2 · Cited by 266
Emerging roles of exosomes during epithelial–mesenchymal transition and cancer progression
Greening, D. W., Gopal, S. K., Mathias, R. A., Liu, L., Sheng, J., Zhu, H.-J., & Simpson, R. J. (2015) · Seminars in Cell & Developmental Biology · doi:10.1016/j.semcdb.2015.02.008 · Cited by 220
Pre-trained multimodal large language model enhances dermatological diagnosis using SkinGPT-4
Zhou, J., He, X., Sun, L., Xu, J., Chen, X., Chu, Y., Zhou, L., Liao, X., Zhang, B., Afvari, S., et al. (2024) · Nature Communications · doi:10.1038/s41467-024-50043-3 · Cited by 189
Deep learning in spectral analysis: Modeling and imaging
Liu, X., An, H., Cai, W., & Shao, X. (2024) · TrAC Trends in Analytical Chemistry · doi:10.1016/j.trac.2024.117612 · Cited by 169
Fang, S., Wu, S., Chen, Z., He, C., Lin, L., & Ye, J. (2024) · TrAC Trends in Analytical Chemistry · doi:10.1016/j.trac.2024.117578 · Cited by 143
Early cancer detection by serum biomolecular fingerprinting spectroscopy with machine learning
Dong, S., He, D., Zhang, Q., Huang, C., Hu, Z., Zhang, C., Nie, L., Wang, K., Luo, W., Yu, J. X., et al. (2023) · eLight · doi:10.1186/s43593-023-00051-5 · Cited by 117
Xue, X., Wang, X., Zhao, Y., Hu, R., & Qin, L. (2018) · Biochemical and Biophysical Research Communications · doi:10.1016/j.bbrc.2018.05.208 · Cited by 116
Pretraining a foundation model for generalizable fluorescence microscopy-based image restoration
Ma, C., Tan, W., He, R., & Yan, B. (2024) · Nature Methods · doi:10.1038/s41592-024-02244-3 · Cited by 108
Deep Learning–Assisted Surface-Enhanced Raman Scattering for Rapid Bacterial Identification
Tseng, Y.-M., Chen, K.-L., Chao, P.-H., Han, Y., & Huang, N. (2023) · ACS Applied Materials & Interfaces · doi:10.1021/acsami.3c03212 · Cited by 99
Nilsson, A., Haanstra, J. R., Engqvist, M. K. M., Gerding, A., Bakker, B. M., Klingmüller, U., Teusink, B., & Nielsen, J. (2020) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1919250117 · Cited by 83
Qin, Y., Lu, X., Shi, Z., Huang, Q., Wang, X., Ren, B. W., & Li, C. (2022) · Analytical Chemistry · doi:10.1021/acs.analchem.2c02226 · Cited by 73
Exosome plays an important role in the development of hepatocellular carcinoma
Li, L.-M., Liu, Z.-X., & Cheng, Q.-Y. (2019) · Pathology - Research and Practice · doi:10.1016/j.prp.2019.152468 · Cited by 59
Liu, Y., Cai, C., Xu, W., Li, B., Wang, L., Peng, Y., Yu, Y., Liu, B., & Zhang, K. (2024) · Analytical Chemistry · doi:10.1021/acs.analchem.4c02914 · Cited by 50
Role of Alpha-Fetoprotein in Hepatocellular Carcinoma Drug Resistance
Li, W., Liu, K., Chen, Y., Zhu, M., & Li, M. (2020) · Current Medicinal Chemistry · doi:10.2174/0929867327999200729151247 · Cited by 49
Karpas, E., Abend, O., Belinkov, Y., Lenz, B., Lieber, O., Ratner, N., Shoham, Y., Bata, H., Levine, Y., Leyton-Brown, K., et al. (2022) · arXiv · doi:10.48550/arxiv.2205.00445 · Cited by 49
Chen, J., Niu, C., Yang, N., Liu, C., Zou, S., & Zhu, S. (2023) · Pharmacological Research · doi:10.1016/j.phrs.2023.106674 · Cited by 40
RaT: Raman Transformer for highly accurate melanoma detection with critical features visualization
Chang, M., He, C., Du, Y., Qiu, Y., Wang, L., & Chen, H. (2023) · Spectrochimica Acta Part A Molecular and Biomolecular Spectroscopy · doi:10.1016/j.saa.2023.123475 · Cited by 39
Self-citationLipid Metabolism and the Liver
Enjoji, M., Kohjima, M., & Nakamuta, M. (2016) · Springer eBooks · doi:10.1007/978-4-431-55790-6_6 · Cited by 32
A ratiometric SERS aptasensor array for human DNA glycosylaseat single-cell sensitivity/resolution
Tian, T., Zhang, K., Yang, W., Zhong, Q., Wang, B., Guo, W., & Liu, B. (2023) · Talanta · doi:10.1016/j.talanta.2023.124544 · Cited by 3
Self-citation
Cited by
The role of agentic artificial intelligence in healthcare: a scoping review
Collaço, B. G., Haider, S. A., Prabha, S., Gomez-Cabello, C. A., Genovese, A., Wood, N. G., Bagaria, S. P., Gopala, N., Tao, C., & Forte, A. J. (2026) · npj Digital Medicine · doi:10.1038/s41746-026-02517-5 · Cited by 127
Machine learning for extracellular vesicles enables diagnostic and therapeutic nanobiotechnology
Tiwari, A. K., Widodo, Krisnawati, D. I., Tzou, K.-Y., & Kuo, T. (2026) · Journal of Nanobiotechnology · doi:10.1186/s12951-025-03952-4 · Cited by 60
Harnessing artificial intelligence for engineering extracellular vesicles
Lü, H., Zhang, J., Shen, T., Jiang, W., Liu, H., & Su, J. (2025) · Extracellular Vesicles and Circulating Nucleic Acids · doi:10.20517/evcna.2025.35 · Cited by 48
Exosomes in Clinical Laboratory: From Biomarker Discovery to Diagnostic Implementation
Aljohani, M. A. (2025) · Medicina · doi:10.3390/medicina61111930 · Cited by 28
Large Language Model Agent for Managing Patients With Suspected Hypertension
Wang, Y., Tan, W., Cheng, S., Peng, C., Jin, P. K., Qin, F., Tang, L., Zhu, T., Wu, B., Liu, J., et al. (2025) · Hypertension · doi:10.1161/hypertensionaha.125.25305 · Cited by 21
Metadata
- Authors
- Yang, Z., Tian, T., Kong, J., & Chen, H.
- Affiliations
- Fudan University (CN)
- Corresponding author
- Tian, Tongtong
- Kong, Jilie
- Chen, Hui
- Venue
- Analytical Chemistry
- Publisher
- American Chemical Society (ACS)
- Published
- 2025-02-11
- Volume
- 97
- Issue
- 8
- Pages
- 4643-4652
- ISSN
- 0003-2700 (ISSN-L)
- 1520-6882
- OpenAlex
- W4407370588
- Cited by
- 46
- References
- 39
- Citations by year
- 2026: 27 · 2025: 19
- FWCI
- 17.26
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- Locations
- Analytical Chemistry (publishedVersion)
- PubMed (publishedVersion)
- Funders
- Science and Technology Commission of Shanghai Municipality (22YF1406300)
- National Natural Science Foundation of China (22127806, 22174022, 22274028, 82202636)
- Topics
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Biophysics › Spectroscopy Techniques in Biomedical and Chemical Research
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Extracellular vesicles in disease
- Physical Sciences › Materials Science › Electronic, Optical and Magnetic Materials › Gold and Silver Nanoparticles Synthesis and Applications
- Keywords
- hepatocellular carcinoma, exosomes, Raman spectroscopy, large language models, retrieval-augmented generation, AI-assisted diagnosis
- MeSH terms
- Deep Learning, Artificial Intelligence, Carcinoma, Hepatocellular, Humans, Liver Neoplasms, Spectrum Analysis, Raman, Biomarkers, Tumor, Exosomes
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.