RAG Combined with Instruction Tuning for Traditional Chinese Medicine Syndrome Differentiation Thinking

  • Chunliang Chen
  • , Ming Guan
  • , Wenjing Yue
  • , Xinyu Wang
  • , Yuanbin Wu
  • , Xiaoling Wang*
  • *Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

The rapid advancements of large language models (LLMs) have opened new avenues for data processing and knowledge extraction, particularly in the medical domain. This paper investigates the application of LLMs in Traditional Chinese Medicine (TCM), with a focus on enhancing the models’ capabilities in syndrome differentiation thinking tasks. We propose a method that delineates the syndrome differentiation process in TCM into four critical steps: clinical information extraction, pathogenesis inference, syndrome inference, and explanatory summarization, with tailored prompting strategies designed for each step. By integrating Retrieval-Augmented Generation (RAG) with instruction tuning, we generated 800 instruction data entries rich in localized knowledge and instruction tuning of a pre-trained model. Experimental results indicate that our approach significantly improves the models’ performance in TCM syndrome differentiation thinking, achieving top rankings in both the A and B leaderboards, with scores of 45.12 and 44.37, respectively.

Original languageEnglish
Title of host publicationHealth Information Processing - 10th China Health Information Processing Conference, CHIP 2024, Proceedings
EditorsYanchun Zhang, Qingcai Chen, Hongfei Lin, Lei Liu, Xiangwen Liao, Buzhou Tang, Tianyong Hao, Zhengxing Huang
PublisherSpringer Science and Business Media Deutschland GmbH
Pages78-89
Number of pages12
ISBN (Print)9789819637515
DOIs
StatePublished - 2025
Event10th China Health Information Processing Conference, CHIP 2024 - Fuzhou, China
Duration: 15 Nov 202417 Nov 2024

Publication series

NameCommunications in Computer and Information Science
Volume2433 CCIS
ISSN (Print)1865-0929
ISSN (Electronic)1865-0937

Conference

Conference10th China Health Information Processing Conference, CHIP 2024
Country/TerritoryChina
CityFuzhou
Period15/11/2417/11/24

Keywords

  • Instruction Tuning
  • RAG
  • TCM LLM

Fingerprint

Dive into the research topics of 'RAG Combined with Instruction Tuning for Traditional Chinese Medicine Syndrome Differentiation Thinking'. Together they form a unique fingerprint.

Cite this