CoChat
Sign Up
PreprintCited by 26Topic ModelingArtificial Intelligence in Healthcare and EducationMultimodal Machine Learning Applications

The DOI matches its DataCite record.

Knowledge-tuning Large Language Models with Structured Medical Knowledge Bases for Reliable Response Generation in Chinese

Open access
Wang, Haochun, Zhao, Sendong, Qiang, Zewen, Li, Zijian, Xi, Nuwa, Du, Yanrui, Cai, MuZhen, Guo, Haoqiang, Chen, Yuhan, Xu, Haoming, Qin, Bing, Liu, Ting·2023·arXiv
DOI 10.48550/arxiv.2309.04175arXiv 2309.04175
Open this paper in CoChat — free accountOpen PDF

Abstract

Large Language Models (LLMs) have demonstrated remarkable success in diverse natural language processing (NLP) tasks in general domains. However, LLMs sometimes generate responses with the hallucination about medical facts due to limited domain knowledge. Such shortcomings pose potential risks in the utilization of LLMs within medical contexts. To address this challenge, we propose knowledge-tuning, which leverages structured medical knowledge bases for the LLMs to grasp domain knowledge efficiently and facilitate reliable response generation. We also release cMedKnowQA, a Chinese medical knowledge question-answering dataset constructed from medical knowledge bases to assess the medical knowledge proficiency of LLMs. Experimental results show that the LLMs which are knowledge-tuned with cMedKnowQA, can exhibit higher levels of accuracy in response generation compared with vanilla instruction-tuning and offer a new reliable way for the domain adaptation of LLMs.

Overview

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

DataCite · 10.48550/arxiv.2309.04175

Cites

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • In medicine, most previous works empower LLM-based agents with external knowledge in their memory.

    “In the field of medicine, most of the previous works empower LLM-based agents with external knowledge in their memory [107, 129, 132, 151, 115].”

    From A Survey on the Memory Mechanism of Large Language Model-based Agents (2025) · cites this paper as [151]

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

No references could be resolved yet.

Research works printed but not linked: 37

  1. Bai, Y.; Jones, A.; Ndousse, K.; Askell, A.; Chen, A.; Das- Sarma, N.; Drain, D.; Fort, S.; Ganguli, D.; Henighan, T.; et al. 2022. Training a helpful and harmless assistant with re- inforcement learning from human feedback. arXiv preprint arXiv:2204.05862. · arXiv
  2. Biderman, S.; Schoelkopf, H.; Anthony, Q.; Bradley, H.; O'Brien, K.; Hallahan, E.; Khan, M. A.; Purohit, S.; Prashanth, U. S.; Raff, E.; Skowron, A.; Sutawika, L.; and van der Wal, O. 2023. Pythia: A Suite for Analyz- ing Large Language Models Across Training and Scaling. arXiv:2304.01373. · arXiv
  3. Brown, T.; Mann, B.; Ryder, N.; Subbiah, M.; Kaplan, J. D.; Dhariwal, P.; Neelakantan, A.; Shyam, P.; Sastry, G.; Askell, A.; et al. 2020. Language models are few-shot learners. Ad- vances in neural information processing systems, 33: 1877- 1901.
  4. Chang, Y.; Wang, X.; Wang, J.; Wu, Y.; Zhu, K.; Chen, H.; Yang, L.; Yi, X.; Wang, C.; Wang, Y.; et al. 2023. A Survey on Evaluation of Large Language Models. arXiv preprint arXiv:2307.03109. · arXiv
  5. Chung, H. W.; Hou, L.; Longpre, S.; Zoph, B.; Tay, Y.; Fe- dus, W.; Li, E.; Wang, X.; Dehghani, M.; Brahma, S.; et al. 2022. Scaling instruction-finetuned language models. arXiv preprint arXiv:2210.11416. · arXiv
  6. Cohen, J. 1960. A coefficient of agreement for nominal scales. Educational and psychological measurement, 20(1): 37-46.
  7. Cui, Y.; Yang, Z.; and Yao, X. 2023. Efficient and Effec- tive Text Encoding for Chinese LLaMA and Alpaca. arXiv preprint arXiv:2304.08177. · arXiv
  8. Gu, Y.; Tinn, R.; Cheng, H.; Lucas, M.; Usuyama, N.; Liu, X.; Naumann, T.; Gao, J.; and Poon, H. 2021. Domain- specific language model pretraining for biomedical natural language processing. ACM Transactions on Computing for Healthcare (HEALTH), 3(1): 1-23.
  9. Hu, E. J.; Wallis, P.; Allen-Zhu, Z.; Li, Y.; Wang, S.; Wang, L.; Chen, W.; et al. 2021. LoRA: Low-Rank Adaptation of Large Language Models. In International Conference on Learning Representations.
  10. Huang, K.; Altosaar, J.; and Ranganath, R. 2019. Clinical- bert: Modeling clinical notes and predicting hospital read- mission. arXiv preprint arXiv:1904.05342. · arXiv
  11. Ji, Z.; Lee, N.; Frieske, R.; Yu, T.; Su, D.; Xu, Y.; Ishii, E.; Bang, Y. J.; Madotto, A.; and Fung, P. 2023. Survey of hal- lucination in natural language generation. ACM Computing Surveys, 55(12): 1-38.
  12. Lee, J.; Yoon, W.; Kim, S.; Kim, D.; Kim, S.; So, C. H.; and Kang, J. 2020. BioBERT: a pre-trained biomedical language representation model for biomedical text mining. Bioinfor- matics, 36(4): 1234-1240.
  13. Lewis, P.; Ott, M.; Du, J.; and Stoyanov, V. 2020. Pretrained Language Models for Biomedical and Clinical Tasks: Un- derstanding and Extending the State-of-the-Art. In Proceed- ings of the 3rd Clinical Natural Language Processing Work- shop, 146-157.
  14. Li, Y.; Li, Z.; Zhang, K.; Dan, R.; and Zhang, Y. 2023. ChatDoctor: A Medical Chat Model Fine-tuned on LLaMA Model using Medical Domain Knowledge. arXiv:2303.14070. · arXiv
  15. Mialon, G.; Dessì, R.; Lomeli, M.; Nalmpantis, C.; Pa- sunuru, R.; Raileanu, R.; Rozière, B.; Schick, T.; Dwivedi- Yu, J.; Celikyilmaz, A.; et al. 2023. Augmented language models: a survey. arXiv preprint arXiv:2302.07842. · arXiv
  16. Michalopoulos, G.; Wang, Y.; Kaka, H.; Chen, H.; and Wong, A. 2021. UmlsBERT: Clinical Domain Knowledge Augmentation of Contextual Embeddings Using the Unified Medical Language System Metathesaurus. In Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Lan- guage Technologies, 1744-1753.
  17. Nakano, R.; Hilton, J.; Balaji, S.; Wu, J.; Ouyang, L.; Kim, C.; Hesse, C.; Jain, S.; Kosaraju, V.; Saunders, W.; et al. 2021. Webgpt: Browser-assisted question-answering with human feedback. arXiv preprint arXiv:2112.09332. · arXiv
  18. Odmaa, B.; Yunfei, Y.; Zhifang, S.; Damai, D.; Baobao, C.; Sujian, L.; and Hongying, Z. 2019. Preliminary study on the construction of Chinese medical knowledge graph. Journal of Chinese Information Processing, 33(10): 1-7. OpenAI. 2022. ChatGPT. https://chat.openai.com.
  19. Ouyang, L.; Wu, J.; Jiang, X.; Almeida, D.; Wainwright, C.; Mishkin, P.; Zhang, C.; Agarwal, S.; Slama, K.; Ray, A.; et al. 2022. Training language models to follow instructions with human feedback. Advances in Neural Information Pro- cessing Systems, 35: 27730-27744.
  20. Paranjape, B.; Lundberg, S.; Singh, S.; Hajishirzi, H.; Zettle- moyer, L.; and Ribeiro, M. T. 2023. ART: Automatic multi- step reasoning and tool-use for large language models. arXiv preprint arXiv:2303.09014. · arXiv
  21. Peng, Y.; Yan, S.; and Lu, Z. 2019. Transfer Learning in Biomedical Natural Language Processing: An Evaluation of BERT and ELMo on Ten Benchmarking Datasets. In Pro- ceedings of the 18th BioNLP Workshop and Shared Task, 58-65.
  22. Robertson, S.; Zaragoza, H.; et al. 2009. The probabilistic relevance framework: BM25 and beyond. Foundations and Trends® in Information Retrieval, 3(4): 333-389.
  23. Sanh, V.; Webson, A.; Raffel, C.; Bach, S. H.; Sutawika, L.; Alyafeai, Z.; Chaffin, A.; Stiegler, A.; Le Scao, T.; Raja, A.; et al. 2022. Multitask Prompted Training Enables Zero-Shot Task Generalization. In Tenth International Conference on Learning Representations (ICLR).
  24. Scao, T. L.; Fan, A.; Akiki, C.; Pavlick, E.; Ilić, S.; Hesslow, D.; Castagné, R.; Luccioni, A. S.; Yvon, F.; Gallé, M.; et al. 2022. Bloom: A 176b-parameter open-access multilingual language model. arXiv preprint arXiv:2211.05100. · arXiv
  25. Schick, T.; Dwivedi-Yu, J.; Dessì, R.; Raileanu, R.; Lomeli, M.; Zettlemoyer, L.; Cancedda, N.; and Scialom, T. 2023. Toolformer: Language models can teach themselves to use tools. arXiv preprint arXiv:2302.04761. · arXiv
  26. Shen, Y.; Song, K.; Tan, X.; Li, D.; Lu, W.; and Zhuang, Y. 2023. Hugginggpt: Solving ai tasks with chatgpt and its friends in huggingface. arXiv preprint arXiv:2303.17580. · arXiv
  27. Thoppilan, R.; De Freitas, D.; Hall, J.; Shazeer, N.; Kul- shreshtha, A.; Cheng, H.-T.; Jin, A.; Bos, T.; Baker, L.; Du, Y.; et al. 2022. Lamda: Language models for dialog appli- cations. arXiv preprint arXiv:2201.08239. · arXiv
  28. Touvron, H.; Lavril, T.; Izacard, G.; Martinet, X.; Lachaux, M.-A.; Lacroix, T.; Rozière, B.; Goyal, N.; Hambro, E.; Azhar, F.; et al. 2023. Llama: Open and efficient founda- tion language models. arXiv preprint arXiv:2302.13971. · arXiv
  29. Wang, H.; Liu, C.; Xi, N.; Qiang, Z.; Zhao, S.; Qin, B.; and Liu, T. 2023. HuaTuo: Tuning LLaMA Model with Chinese Medical Knowledge. arXiv preprint arXiv:2304.06975. · arXiv
  30. Wang, H.; Liu, C.; Xi, N.; Zhao, S.; Ju, M.; Zhang, S.; Zhang, Z.; Zheng, Y.; Qin, B.; and Liu, T. 2022a. Prompt Combines Paraphrase: Teaching Pre-trained Models to Un- derstand Rare Biomedical Words. In Proceedings of the 29th International Conference on Computational Linguis- tics, 1422-1431. International Committee on Computational Linguistics.
  31. Wang, Y.; Kordi, Y.; Mishra, S.; Liu, A.; Smith, N. A.; Khashabi, D.; and Hajishirzi, H. 2022b. Self-Instruct: Align- ing Language Model with Self Generated Instructions. arXiv preprint arXiv:2212.10560. · arXiv
  32. Wei, J.; Bosma, M.; Zhao, V.; Guu, K.; Yu, A. W.; Lester, B.; Du, N.; Dai, A. M.; and Le, Q. V. 2022. Finetuned Language Models are Zero-Shot Learners. In International Conference on Learning Representations.
  33. Xiong, H.; Wang, S.; Zhu, Y.; Zhao, Z.; Liu, Y.; Wang, Q.; and Shen, D. 2023. Doctorglm: Fine-tuning your chinese doctor is not a herculean task. arXiv preprint arXiv:2304.01097. · arXiv
  34. Yao, S.; Zhao, J.; Yu, D.; Du, N.; Shafran, I.; Narasimhan, K.; and Cao, Y. 2022. React: Synergizing reasoning and act- ing in language models. arXiv preprint arXiv:2210.03629. · arXiv
  35. Zhang, H.; Chen, J.; Jiang, F.; Yu, F.; Chen, Z.; Li, J.; Chen, G.; Wu, X.; Zhang, Z.; Xiao, Q.; Wan, X.; Wang, B.; and Li, H. 2023. HuatuoGPT, Towards Taming Language Models To Be a Doctor. arXiv preprint arXiv:2305.15075. · arXiv
  36. Zhang, T.; Cai, Z.; Wang, C.; Qiu, M.; Yang, B.; and He, X. 2021. SMedBERT: A Knowledge-Enhanced Pre-trained Language Model with Structured Semantics for Medical Text Mining. In Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Pro- cessing (Volume 1: Long Papers), 5882-5893.
  37. Zhao, W. X.; Liu, J.; Ren, R.; and Wen, J.-R. 2022. Dense text retrieval based on pretrained language models: A survey. arXiv preprint arXiv:2211.14876. · arXiv

Cited by

Sorted by citations

Metadata

Authors
Wang, H., Zhao, S., Qiang, Z., Li, Z., Xi, N., Du, Y., Cai, M., Guo, H., Chen, Y., Xu, H., Qin, B., & Liu, T.
Affiliations
Harbin Institute of Technology (CN)
ORCID
Venue
arXiv
Publisher
arXiv
Published
2023
Volume
19
Issue
2
Pages
1-17
ISSN
1556-4681 (ISSN-L)
DOI
10.48550/arxiv.2309.04175
arXiv
2309.04175
OpenAlex
W4401379766
Cited by
26
References
0
Citations by year
2026: 5 · 2025: 14 · 2024: 6 · 2023: 1
FWCI
3.70
Type
journal article
Language
en
Open access
Licence
Locations
  • ACM Transactions on Knowledge Discovery from Data (publishedVersion)
  • arXiv (Cornell University) (submittedVersion, other-oa)
  • arXiv (Cornell University)
Funders
  • Natural Science Foundation of Heilongjiang Province (YQ2022F006)
  • National Key Research and Development Program of China (2021ZD0113302)
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
  • Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Multimodal Machine Learning Applications
Keywords
large language models, medical knowledge base, domain adaptation

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review