TY - JOUR
T1 - Research on the development of an automated system for psychology questionnaire generation based on large language models
AU - Yuan, Zhitao
AU - Jia, Chenghao
AU - Lan, Man
AU - Zhao, Lixin
AU - Chen, Zhixian
AU - Yang, Mengyuan
AU - Liu, Xufeng
AU - Ni, Na
AU - Wu, Shengjun
N1 - Publisher Copyright:
© 2026 Public Library of Science. All rights reserved.
PY - 2026/4
Y1 - 2026/4
N2 - This study reimagined the psychology questionnaire development process using large language model ((LLM) technology, aiming to overcome the protracted preparation cycles and significant human bias inherent in traditional scale development. We developed a specialized fine-tuning scheme for a corpus of 169 professional psychological questionnaires. By integrating instruction fine-tuning with human feedback reinforcement, we significantly enhanced the adaptability of the Qwen-2.5 and GLM-4 models for demanding professional psychological assessment tasks. The optimized models demonstrated remarkable gains across key dimensions: text generation quality (BLEU-4 increased by 0.05, ROUGE-L by 0.057), scientific rigor (logical consistency improved by 28.6%), and cultural adaptability (achieving over 85% accuracy in cross-regional expression conversion). This research solidly supports the feasibility of leveraging LLM technology to drive research paradigm transformation in psychology, offering crucial methodological support for developing efficient, intelligent psychological measurement tools.
AB - This study reimagined the psychology questionnaire development process using large language model ((LLM) technology, aiming to overcome the protracted preparation cycles and significant human bias inherent in traditional scale development. We developed a specialized fine-tuning scheme for a corpus of 169 professional psychological questionnaires. By integrating instruction fine-tuning with human feedback reinforcement, we significantly enhanced the adaptability of the Qwen-2.5 and GLM-4 models for demanding professional psychological assessment tasks. The optimized models demonstrated remarkable gains across key dimensions: text generation quality (BLEU-4 increased by 0.05, ROUGE-L by 0.057), scientific rigor (logical consistency improved by 28.6%), and cultural adaptability (achieving over 85% accuracy in cross-regional expression conversion). This research solidly supports the feasibility of leveraging LLM technology to drive research paradigm transformation in psychology, offering crucial methodological support for developing efficient, intelligent psychological measurement tools.
UR - https://www.scopus.com/pages/publications/105036905934
U2 - 10.1371/journal.pone.0345117
DO - 10.1371/journal.pone.0345117
M3 - 文章
C2 - 42030258
AN - SCOPUS:105036905934
SN - 1932-6203
VL - 21
JO - PLoS ONE
JF - PLoS ONE
IS - 4 April
M1 - e0345117
ER -