TY - GEN
T1 - Prompt Debiasing via Causal Intervention for Event Argument Extraction
AU - Lin, Jiaju
AU - Zhou, Jie
AU - Chen, Qin
N1 - Publisher Copyright:
© The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd. 2025.
PY - 2025
Y1 - 2025
N2 - Prompt-based methods have become increasingly popular among information extraction tasks (e.g., event argument extraction), especially in low-data scenarios. By formatting a fine-tuning task into a pre-training objective, prompt-based methods resolve the data scarce problem effectively. However, previous researches seldom investigate the discrepancy among different strategies on prompt formulation. In this work, we compare two kinds of prompts, name and ontology-based prompts, and reveal how ontology-based prompts exceed its counterpart in event argument extraction. Furthermore, we analyse the potential risk (e.g., biases) in ontology-based prompts via a causal view and propose a debiasing method using causal intervention. Experiments on three benchmarks demonstrate that modified by our debiasing method, the baseline model becomes more robust, with significant improvement in the resistance to adversarial attacks. 1Our code is available at this repository.
AB - Prompt-based methods have become increasingly popular among information extraction tasks (e.g., event argument extraction), especially in low-data scenarios. By formatting a fine-tuning task into a pre-training objective, prompt-based methods resolve the data scarce problem effectively. However, previous researches seldom investigate the discrepancy among different strategies on prompt formulation. In this work, we compare two kinds of prompts, name and ontology-based prompts, and reveal how ontology-based prompts exceed its counterpart in event argument extraction. Furthermore, we analyse the potential risk (e.g., biases) in ontology-based prompts via a causal view and propose a debiasing method using causal intervention. Experiments on three benchmarks demonstrate that modified by our debiasing method, the baseline model becomes more robust, with significant improvement in the resistance to adversarial attacks. 1Our code is available at this repository.
KW - Causal Intervention
KW - Event Argument Extraction
KW - Prompt Learning
UR - https://www.scopus.com/pages/publications/85210104193
U2 - 10.1007/978-981-97-9434-8_8
DO - 10.1007/978-981-97-9434-8_8
M3 - 会议稿件
AN - SCOPUS:85210104193
SN - 9789819794331
T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
SP - 96
EP - 108
BT - Natural Language Processing and Chinese Computing - 13th National CCF Conference, NLPCC 2024, Proceedings
A2 - Wong, Derek F.
A2 - Wei, Zhongyu
A2 - Yang, Muyun
PB - Springer Science and Business Media Deutschland GmbH
T2 - 13th CCF International Conference on Natural Language Processing and Chinese Computing, NLPCC 2024
Y2 - 1 November 2024 through 3 November 2024
ER -