TY - JOUR
T1 - An interpretable polytomous cognitive diagnosis framework for predicting examinee performance
AU - Li, Xiaoyu
AU - Guo, Shaoyang
AU - Wu, Jin
AU - Zheng, Chanjin
N1 - Publisher Copyright:
© 2024 Elsevier Ltd
PY - 2025/1
Y1 - 2025/1
N2 - As a fundamental task of intelligent education, deep learning-based cognitive diagnostic models (CDMs) have been introduced to effectively model dichotomous testing data. However, it remains a challenge to model the polytomous data within the deep-learning framework. This paper proposed a novel Polytomous Cognitive Diagnosis Framework (PCDF), which employs Cumulative Category Response Function (CCRF) theory to partition and consolidate data, thereby enabling existing cognitive diagnostic models to seamlessly analyze graded response data. By combining the proposed PCDF with IRT, MIRT, NCDM, KaNCD, and ICDM, extensive experiments were complemented by data re-encoding techniques on the four real-world graded scoring datasets, along with baseline methods such as linear-split, one-vs-all, and random. The results suggest that when combined with existing CDMs, PCDF outperforms the baseline models in terms of prediction. Additionally, we showcase the interpretability of examinee ability and item parameters through the utilization of PCDF.
AB - As a fundamental task of intelligent education, deep learning-based cognitive diagnostic models (CDMs) have been introduced to effectively model dichotomous testing data. However, it remains a challenge to model the polytomous data within the deep-learning framework. This paper proposed a novel Polytomous Cognitive Diagnosis Framework (PCDF), which employs Cumulative Category Response Function (CCRF) theory to partition and consolidate data, thereby enabling existing cognitive diagnostic models to seamlessly analyze graded response data. By combining the proposed PCDF with IRT, MIRT, NCDM, KaNCD, and ICDM, extensive experiments were complemented by data re-encoding techniques on the four real-world graded scoring datasets, along with baseline methods such as linear-split, one-vs-all, and random. The results suggest that when combined with existing CDMs, PCDF outperforms the baseline models in terms of prediction. Additionally, we showcase the interpretability of examinee ability and item parameters through the utilization of PCDF.
KW - Cognitive diagnosis
KW - Examinee performance
KW - General graded-response model
KW - Polytomous data
UR - https://www.scopus.com/pages/publications/85205267562
U2 - 10.1016/j.ipm.2024.103913
DO - 10.1016/j.ipm.2024.103913
M3 - 文章
AN - SCOPUS:85205267562
SN - 0306-4573
VL - 62
JO - Information Processing and Management
JF - Information Processing and Management
IS - 1
M1 - 103913
ER -