TY - JOUR
T1 - Enhancing Online Learning
T2 - A Multimodal Approach for Cognitive Load Assessment
AU - Xue, Yaofeng
AU - Wang, Kun
AU - Qiu, Yisheng
N1 - Publisher Copyright:
© 2024 Taylor & Francis Group, LLC.
PY - 2025
Y1 - 2025
N2 - Online learning has become increasingly popular in recent years, but the frequent occurrence of cognitive overload has been notably impacting both the learning experience and effectiveness. Therefore, based on optimizing online learning, this study proposes a research framework for cognitive load assessment of online learning based on three modal data: electroencephalography (EEG), eye tracking, and face. Following this framework, a neural network was used to construct a cognitive load assessment model for online learning that integrates multimodal data. After validation, the assessment accuracy of the model reaches 91.52%. In addition, the results based on multimodal data analysis can be used as a reference for the development of learning resources and the optimization of online courses in intelligent online learning platforms. The assessment model constructed in this study can also be applied to the online learning platform, which is expected to realize prescription-adaptive online learning based on cognitive load assessment. Due to current research limitations, only specific thematic learning models have been explored. Future research will focus on model fine-tuning, complex learning scenarios and themes designing and expansion of research scale to enhance the model’s generalization capabilities.
AB - Online learning has become increasingly popular in recent years, but the frequent occurrence of cognitive overload has been notably impacting both the learning experience and effectiveness. Therefore, based on optimizing online learning, this study proposes a research framework for cognitive load assessment of online learning based on three modal data: electroencephalography (EEG), eye tracking, and face. Following this framework, a neural network was used to construct a cognitive load assessment model for online learning that integrates multimodal data. After validation, the assessment accuracy of the model reaches 91.52%. In addition, the results based on multimodal data analysis can be used as a reference for the development of learning resources and the optimization of online courses in intelligent online learning platforms. The assessment model constructed in this study can also be applied to the online learning platform, which is expected to realize prescription-adaptive online learning based on cognitive load assessment. Due to current research limitations, only specific thematic learning models have been explored. Future research will focus on model fine-tuning, complex learning scenarios and themes designing and expansion of research scale to enhance the model’s generalization capabilities.
KW - EEG signals
KW - Multimodal data
KW - cognitive load
KW - eye tracking
KW - facial action recognition
KW - online learning
UR - https://www.scopus.com/pages/publications/86000380981
U2 - 10.1080/10447318.2024.2327198
DO - 10.1080/10447318.2024.2327198
M3 - 文章
AN - SCOPUS:86000380981
SN - 1044-7318
VL - 41
SP - 2692
EP - 2702
JO - International Journal of Human-Computer Interaction
JF - International Journal of Human-Computer Interaction
IS - 4
ER -