Skip to main navigation Skip to search Skip to main content

Research on the development of an automated system for psychology questionnaire generation based on large language models

  • Zhitao Yuan
  • , Chenghao Jia
  • , Man Lan
  • , Lixin Zhao
  • , Zhixian Chen
  • , Mengyuan Yang
  • , Xufeng Liu
  • , Na Ni*
  • , Shengjun Wu*
  • *Corresponding author for this work
  • Shaanxi University of Chinese Medicine
  • Air Force Medical University
  • East China Normal University

Research output: Contribution to journalArticlepeer-review

Abstract

This study reimagined the psychology questionnaire development process using large language model ((LLM) technology, aiming to overcome the protracted preparation cycles and significant human bias inherent in traditional scale development. We developed a specialized fine-tuning scheme for a corpus of 169 professional psychological questionnaires. By integrating instruction fine-tuning with human feedback reinforcement, we significantly enhanced the adaptability of the Qwen-2.5 and GLM-4 models for demanding professional psychological assessment tasks. The optimized models demonstrated remarkable gains across key dimensions: text generation quality (BLEU-4 increased by 0.05, ROUGE-L by 0.057), scientific rigor (logical consistency improved by 28.6%), and cultural adaptability (achieving over 85% accuracy in cross-regional expression conversion). This research solidly supports the feasibility of leveraging LLM technology to drive research paradigm transformation in psychology, offering crucial methodological support for developing efficient, intelligent psychological measurement tools.

Original languageEnglish
Article numbere0345117
JournalPLoS ONE
Volume21
Issue number4 April
DOIs
StatePublished - Apr 2026

Fingerprint

Dive into the research topics of 'Research on the development of an automated system for psychology questionnaire generation based on large language models'. Together they form a unique fingerprint.

Cite this