Skip to main navigation Skip to search Skip to main content

UniSpLLM: An Integrated Approach for Enhancing Reasoning and Education with Large Language Models

  • Hanyu Zhao
  • , Yuzhuo Wu
  • , Yang Yu
  • , Xiaohua Yu
  • , Liangyu Chen
  • East China Normal University

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

Abstract

Large Language Models (LLMs) show constrained performance when confronted with a set of mathematical problems spanning various knowledge concepts. Unlike natural language tasks, the understanding and solution strategies for math problems significantly vary, presenting a great challenge for LLMs to consistently generate precise solutions for different problem types. To address this limitation, we propose UniSpLLM(A Universal Template integrated with Specific methods using Large Language Models), a strategy devised to bolster LLMs' efficiency in solving problems enriched with varied knowledge concepts. UniSpLLM innovates by crafting a Universal Template, versatile enough to accommodate any problem type. Specifically, we design six Specific Methods that can be adapted to different problem types. UniSpLLM distinguishes itself from other prompt-based approaches, which typically cater to a singular problem type. By achieving an improvement of nearly 15% on the latest dataset TAL_SAQ6K_EN from AAAI2024 and surpassing the GPT-4 baseline by almost 17% on the MMLU-Math dataset, UniSpLLM significantly elevates the utility of LLMs within educational fields. Our approach and results hold significant educational value, as they aid students in acquiring diverse thinking skills tailored to various problem types.

Original languageEnglish
Title of host publicationProceedings of the 32nd International Conference on Computers in Education, ICCE 2024
EditorsMaria Mercedes T. RODRIGO, Akihiro KASHIHARA, Hiroaki OGATA, Bo JIANG, Jessica O. SUGAY, Ju-Ling SHIH, Lung-Hsiang WONG
PublisherAsia-Pacific Society for Computers in Education
VolumePartF3
ISBN (Print)9786269689040
DOIs
StatePublished - 2024
Event32nd International Conference on Computers in Education, ICCE 2024 - Quezon City, Philippines
Duration: 25 Nov 2024 → 29 Nov 2024

Conference

Conference32nd International Conference on Computers in Education, ICCE 2024
Country/TerritoryPhilippines
CityQuezon City
Period25/11/24 → 29/11/24

Keywords

  • Large Language Models
  • Math Education
  • Math Word Problems Solving
  • Mathematical Reasoning
  • Prompt-Based Approach

Fingerprint

Dive into the research topics of 'UniSpLLM: An Integrated Approach for Enhancing Reasoning and Education with Large Language Models'. Together they form a unique fingerprint.

Cite this