TY - JOUR
T1 - EduAgentQG
T2 - Multi-agent personalized mathematics question generation with explicit diversity and objective-aware evaluation
AU - Jia, Rui
AU - Zhang, Min
AU - Liu, Fengrui
AU - Jiang, Bo
AU - Kuang, Kun
AU - Dai, Zhongxiang
N1 - Publisher Copyright:
© 2026 Elsevier Ltd. All rights are reserved, including those for text and data mining, AI training, and similar technologies.
PY - 2027/2
Y1 - 2027/2
N2 - In intelligent education, personalized mathematics question generation aims to produce mathematics questions that satisfy educational requirements while supporting adaptive assessment and learning. Existing LLM-based single-agent and multi-agent methods improve generation flexibility, but they still tend to rely on aggregated feedback or model randomness, making it difficult to jointly ensure dimension-wise objective alignment and controllable diversity. To address these challenges, we propose EduAgentQG, a multi-agent collaborative framework for personalized mathematics question generation with explicit diversity and objective-aware evaluation. EduAgentQG organizes question generation as a closed-loop process of planning, writing, evaluation, refinement, and checking: structured generation plans and multiple generation directions guide candidate generation, while fine-grained evaluation verifies logical correctness, solvability, and objective alignment in knowledge concepts, difficulty, grade level, and core competencies. We first construct a mathematics question generation benchmark containing 10,273 questions across Grades 1–9, covering 634 knowledge concepts, 16 core competencies, and three difficulty levels; for evaluation, it is organized into two subsets: MathChoice, with 489 educational objectives for multiple-choice question generation, and MathBlank, with 500 educational objectives for fill-in-the-blank question generation. Experiments using Gemini-2.5-Flash, GPT-4o-mini, and Qwen2.5-72B-Instruct show that EduAgentQG consistently outperforms COT, COTN[jls-end-space/], ReAct, and EQPR in diversity, Objective Consistency, and Win Rate. On Gemini-2.5-Flash, EduAgentQG improves Win Rate by 3.90 and 4.75 percentage points on MathChoice and MathBlank, respectively, over the strongest baseline, demonstrating its ability to generate diverse, solvable, and educationally aligned personalized mathematics questions with stronger controllability.
AB - In intelligent education, personalized mathematics question generation aims to produce mathematics questions that satisfy educational requirements while supporting adaptive assessment and learning. Existing LLM-based single-agent and multi-agent methods improve generation flexibility, but they still tend to rely on aggregated feedback or model randomness, making it difficult to jointly ensure dimension-wise objective alignment and controllable diversity. To address these challenges, we propose EduAgentQG, a multi-agent collaborative framework for personalized mathematics question generation with explicit diversity and objective-aware evaluation. EduAgentQG organizes question generation as a closed-loop process of planning, writing, evaluation, refinement, and checking: structured generation plans and multiple generation directions guide candidate generation, while fine-grained evaluation verifies logical correctness, solvability, and objective alignment in knowledge concepts, difficulty, grade level, and core competencies. We first construct a mathematics question generation benchmark containing 10,273 questions across Grades 1–9, covering 634 knowledge concepts, 16 core competencies, and three difficulty levels; for evaluation, it is organized into two subsets: MathChoice, with 489 educational objectives for multiple-choice question generation, and MathBlank, with 500 educational objectives for fill-in-the-blank question generation. Experiments using Gemini-2.5-Flash, GPT-4o-mini, and Qwen2.5-72B-Instruct show that EduAgentQG consistently outperforms COT, COTN[jls-end-space/], ReAct, and EQPR in diversity, Objective Consistency, and Win Rate. On Gemini-2.5-Flash, EduAgentQG improves Win Rate by 3.90 and 4.75 percentage points on MathChoice and MathBlank, respectively, over the strongest baseline, demonstrating its ability to generate diverse, solvable, and educationally aligned personalized mathematics questions with stronger controllability.
KW - Adaptive learning
KW - Multi-agent framework
KW - Personalized Question Generation
UR - https://www.scopus.com/pages/publications/105049067472
U2 - 10.1016/j.ipm.2026.105118
DO - 10.1016/j.ipm.2026.105118
M3 - 文章
AN - SCOPUS:105049067472
SN - 0306-4573
VL - 64
JO - Information Processing and Management
JF - Information Processing and Management
IS - 2
M1 - 105118
ER -