Enhancing Online Learning: A Multimodal Approach for Cognitive Load Assessment

Yaofeng Xue*, Kun Wang, Yisheng Qiu

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

9 Scopus citations

Abstract

Online learning has become increasingly popular in recent years, but the frequent occurrence of cognitive overload has been notably impacting both the learning experience and effectiveness. Therefore, based on optimizing online learning, this study proposes a research framework for cognitive load assessment of online learning based on three modal data: electroencephalography (EEG), eye tracking, and face. Following this framework, a neural network was used to construct a cognitive load assessment model for online learning that integrates multimodal data. After validation, the assessment accuracy of the model reaches 91.52%. In addition, the results based on multimodal data analysis can be used as a reference for the development of learning resources and the optimization of online courses in intelligent online learning platforms. The assessment model constructed in this study can also be applied to the online learning platform, which is expected to realize prescription-adaptive online learning based on cognitive load assessment. Due to current research limitations, only specific thematic learning models have been explored. Future research will focus on model fine-tuning, complex learning scenarios and themes designing and expansion of research scale to enhance the model’s generalization capabilities.

Original languageEnglish
Pages (from-to)2692-2702
Number of pages11
JournalInternational Journal of Human-Computer Interaction
Volume41
Issue number4
DOIs
StatePublished - 2025

Keywords

  • EEG signals
  • Multimodal data
  • cognitive load
  • eye tracking
  • facial action recognition
  • online learning

Fingerprint

Dive into the research topics of 'Enhancing Online Learning: A Multimodal Approach for Cognitive Load Assessment'. Together they form a unique fingerprint.

Cite this