Skip to main navigation Skip to search Skip to main content

ExplainDrive: A Multimodal Chain-of-Thought Reasoning Approach for Explainable Automated Driving Systems

  • Xing Yu
  • , Jinghan Peng
  • , Hang Li
  • , Ermuyun Li
  • , Dehui Du*
  • *Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

End-to-end decision models based on deep learning have become increasingly prominent in automated driving systems. However, their black-box nature poses significant challenges to interpreting decision processes, especially in dynamic and complex scenarios. Existing approaches largely focus on post-hoc analyses or isolated single-step explanations, lacking comprehensive explanations from scenario understanding to decision-making and failing to address the complexity of real-world scenarios with coherent reasoning. To address these limitations, we propose ExplainDrive, a multimodal Chain-of-Thought reasoning framework that integrates causally optimized temporal representations with explainable decision-making. ExplainDrive follows a three-stage pipeline: (i) extracting spatio-temporal features via a Causal Temporal Former, (ii) constructing hierarchical scenario understanding, and (iii) progressively deriving driving decisions with interpretable rationales. This design enhances transparency at each intermediate step and mitigates spurious correlations through causal feature selection. Extensive experiments on the BDD-X and nuScenes datasets demonstrate that ExplainDrive consistently improves the quality of decision explanations and outperforms compared models across multiple key evaluation metrics.

Original languageEnglish
Title of host publication2025 IEEE International Conference on Systems, Man, and Cybernetics
Subtitle of host publicationNavigating Frontiers: Smart Systems for a Dynamic World, SMC 2025 - Proceedings
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages1946-1952
Number of pages7
ISBN (Electronic)9798331533588
DOIs
StatePublished - 2025
Event2025 IEEE International Conference on Systems, Man, and Cybernetics, SMC 2025 - Hybrid, Vienna, Austria
Duration: 5 Oct 20258 Oct 2025

Publication series

NameConference Proceedings - IEEE International Conference on Systems, Man and Cybernetics
ISSN (Print)1062-922X
ISSN (Electronic)2577-1655

Conference

Conference2025 IEEE International Conference on Systems, Man, and Cybernetics, SMC 2025
Country/TerritoryAustria
CityHybrid, Vienna
Period5/10/258/10/25

Keywords

  • automated driving systems
  • chain-of-thought reasoning
  • explainability
  • multimodal large language models

Fingerprint

Dive into the research topics of 'ExplainDrive: A Multimodal Chain-of-Thought Reasoning Approach for Explainable Automated Driving Systems'. Together they form a unique fingerprint.

Cite this