Generating Contextualized Mathematics Multiple-Choice Questions Utilizing Large Language Models

Ruijia Li, Yiting Wang, Chanjin Zheng, Yuan Hao Jiang, Bo Jiang*

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

5 Scopus citations

Abstract

Applying mathematics to solve authentic question play important roles in math-ematics education. How to generate high-quality multiple-choice questions that have authentic context is a great challenge. By combining multiple iterations of large language model dialogues with auxiliary external tools and the LangChain framework, this work presents a novel method for automatically generating contextualized multiple-choice mathematics questions. To check the quality of generated questions, 30 questions were randomly selected and 13 human experts were invited to rate these questions. The survey result indicates that the questions produced by the proposed method exhibit a significantly higher quality compared to those generated directly by GPT4, and are already quite comparable in performance to questions that are meticulously crafted by humans across multiple dimensions. The code is available on the project home page: https://github.com/youzizzz1028/MCQ-generation-Chain.

Original languageEnglish
Title of host publicationArtificial Intelligence in Education. Posters and Late Breaking Results, Workshops and Tutorials, Industry and Innovation Tracks, Practitioners, Doctoral Consortium and Blue Sky - 25th International Conference, AIED 2024, Proceedings
EditorsAndrew M. Olney, Irene-Angelica Chounta, Zitao Liu, Olga C. Santos, Ig Ibert Bittencourt
PublisherSpringer Science and Business Media Deutschland GmbH
Pages494-501
Number of pages8
ISBN (Print)9783031643149
DOIs
StatePublished - 2024
Event25th International Conference on Artificial Intelligence in Education, AIED 2024 - Recife, Brazil
Duration: 8 Jul 202412 Jul 2024

Publication series

NameCommunications in Computer and Information Science
Volume2150 CCIS
ISSN (Print)1865-0929
ISSN (Electronic)1865-0937

Conference

Conference25th International Conference on Artificial Intelligence in Education, AIED 2024
Country/TerritoryBrazil
CityRecife
Period8/07/2412/07/24

Keywords

  • Automatic Question Generation
  • ChatGPT
  • Core Literacy
  • LangChain
  • Prompt Engineering

Fingerprint

Dive into the research topics of 'Generating Contextualized Mathematics Multiple-Choice Questions Utilizing Large Language Models'. Together they form a unique fingerprint.

Cite this