Skip to main navigation Skip to search Skip to main content

Beyond Scores: Explainable Intelligent Assessment Strengthens Pre-service Teachers' Assessment Literacy

  • Yuang Wei
  • , Fei Wang
  • , Yifan Zhang
  • , Brian Y. Lim
  • , Bo Jiang*
  • *Corresponding author for this work
  • East China Normal University
  • National University of Singapore

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

Abstract

Assessment literacy (AL) is essential for personalized education, yet difficult to cultivate in pre-service teachers. Conventional teacher preparation programs focus on theoretical knowledge, while digital assessment tools commonly provide opaque scores or parameters. These limitations hinder reflection and transfer, leaving AL underdeveloped. We propose XIA, an eXplainable Intelligent Assessment platform that extends statistics-informed support with visualized cognitive diagnostic reasoning, including contrastive and counterfactual explanations. In a pre-post controlled study with 21 pre-service teachers, we combined quantitative tasks and questionnaires with qualitative interviews. The findings offer preliminary evidence that XIA supported reflection, self-regulation, and assessment awareness, and helped reduce assessment errors. Interviews further showed a shift from score-based judgments toward evidence-based reasoning. This work contributes insights into the design of intelligent assessment tools, showing how explanatory scaffolding can bridge assessment theory and classroom practice and support the cultivation of AL in teacher education.

Original languageEnglish
Title of host publicationCHI 2026 - Proceedings of the 2026 CHI Conference on Human Factors in Computing Systems
EditorsNuria Oliver, David A. Shamma, Heloisa Candello, Pablo Cesar, Pedro Lopes, Alessandro Bozzon, Thomas Kosch, Vera Liao, Xiaojuan Ma, Valentino Artizzu, Fiona Draxler, Gustavo Lopez, Anke V. Reinschluessel, Xin Tong, Phoebe O. Toups Dugas
PublisherAssociation for Computing Machinery
ISBN (Electronic)9798400722783
DOIs
StatePublished - 13 Apr 2026
Event2026 CHI Conference on Human Factors in Computing Systems, CHI 2026 - Barcelona, Spain
Duration: 13 Apr 2026 → 17 Apr 2026

Publication series

NameConference on Human Factors in Computing Systems - Proceedings

Conference

Conference2026 CHI Conference on Human Factors in Computing Systems, CHI 2026
Country/TerritorySpain
CityBarcelona
Period13/04/26 → 17/04/26

Keywords

  • Assessment Literacy
  • Cognitive Diagnosis
  • Explainable Models
  • Intelligent Assessment System
  • Pre-service Teachers

Fingerprint

Dive into the research topics of 'Beyond Scores: Explainable Intelligent Assessment Strengthens Pre-service Teachers' Assessment Literacy'. Together they form a unique fingerprint.

Cite this