TY - JOUR
T1 - Causality-Driven Debiased Prototype Learning for Few-Shot Semantic Segmentation
AU - Wang, Hailing
AU - Chen, Yu
AU - Zhang, Xinyue
AU - Cao, Guitao
AU - Cao, Wenming
N1 - Publisher Copyright:
© 1999 IEEE.
PY - 2026
Y1 - 2026
N2 - Prototype-based approaches have emerged as a dominant method in few-shot semantic segmentation, where prototype representations serve as class-level embeddings to transfer knowledge from support to query samples. However, their effectiveness on novel classes is often undermined by the unreliability of prototypes constructed from limited support data. To alleviate this challenge, we propose CauDPL, a causality-driven prototype learning framework that examines the confounding effects of pre-trained knowledge on prototype extraction, thereby enhancing prototype robustness. Specifically, CauDPL constructs a structural causal model (SCM) to explicitly represent the causal relationships among pre-trained knowledge, sample features, and segmentation predictions, allowing for principled reasoning about how shared features across different classes influence prototype reliability. Based on this SCM, CauDPL applies causal intervention via backdoor adjustment to mitigate the confounding effects of global base-category semantic information, thereby reducing spurious correlations between sample features and class labels in few-shot scenarios and enhancing the generalization of prototypes to novel classes. Experiments on two widely-used datasets demonstrate the effectiveness of CauDPL in reducing biases and its applicability to other state-of-the-art methods.
AB - Prototype-based approaches have emerged as a dominant method in few-shot semantic segmentation, where prototype representations serve as class-level embeddings to transfer knowledge from support to query samples. However, their effectiveness on novel classes is often undermined by the unreliability of prototypes constructed from limited support data. To alleviate this challenge, we propose CauDPL, a causality-driven prototype learning framework that examines the confounding effects of pre-trained knowledge on prototype extraction, thereby enhancing prototype robustness. Specifically, CauDPL constructs a structural causal model (SCM) to explicitly represent the causal relationships among pre-trained knowledge, sample features, and segmentation predictions, allowing for principled reasoning about how shared features across different classes influence prototype reliability. Based on this SCM, CauDPL applies causal intervention via backdoor adjustment to mitigate the confounding effects of global base-category semantic information, thereby reducing spurious correlations between sample features and class labels in few-shot scenarios and enhancing the generalization of prototypes to novel classes. Experiments on two widely-used datasets demonstrate the effectiveness of CauDPL in reducing biases and its applicability to other state-of-the-art methods.
KW - Causal Inference
KW - Inter-Class Bias
KW - Prototype Learning
KW - Semantic Segmentation
UR - https://www.scopus.com/pages/publications/105050498742
U2 - 10.1109/TMM.2026.3733026
DO - 10.1109/TMM.2026.3733026
M3 - 文章
AN - SCOPUS:105050498742
SN - 1520-9210
JO - IEEE Transactions on Multimedia
JF - IEEE Transactions on Multimedia
ER -