跳到主要导航 跳到搜索 跳到主要内容

融合 RAG 和大语言模型微调的学术短文本学科分类研究

  • Duxin Shang
  • , Yufeng Duan*
  • , Ping Bai
  • , Jiahong Xie
  • , Yanzuo Liu
  • *此作品的通讯作者
  • East China Normal University

科研成果: 期刊稿件文章同行评审

摘要

[Purpose/Significance] Research on disciplinary classification of academic short texts can effectively enhance the bibliometric analysis of scholarly papers.[Method/Process]This paper proposed an academic short-text classification framework that integrates Retrieval-Augmented Generation(RAG)with large language model fine-tuning. By dynamically retrieving discipline-related information and combining parameter-efficient fine-tuning techniques, the framework enhanced the semantic representation of model inputs while achieving deep adaptation to domain-specific tasks. [Result/Conclusion]Experiments demonstrate that, compared to traditional deep learning models and general large language models, the synergistic paradigm integrating LoRA fine-tuning and RAG significantly enhances multi-label classification performance. The classification error rate decreases by 36.8%, while accuracy, coverage, and top-label error rate all achieve optimal levels. The classification framework integrating RAG and large language model fine-tuning exhibits synergistic advantages in multi-label classification of academic short texts. Its modular architecture provides a technical pathway for cross-disciplinary knowledge transfer, holding significant academic value and practical implications.

投稿的翻译标题Research on Academic Short Text Subject Classification Combining RAG and Large Language Model Fine-Tuning
源语言繁体中文
页(从-至)18-29
页数12
期刊Journal of Modern Information
46
3
DOI
出版状态已出版 - 3月 2026

关键词

  • academic short text classification
  • large language models
  • LoRA fine-tuning
  • Retrieval-Augmented Generation(RAG)
  • subject classification

指纹

探究 '融合 RAG 和大语言模型微调的学术短文本学科分类研究' 的科研主题。它们共同构成独一无二的指纹。

引用此