Prompt Debiasing via Causal Intervention for Event Argument Extraction

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

Prompt-based methods have become increasingly popular among information extraction tasks (e.g., event argument extraction), especially in low-data scenarios. By formatting a fine-tuning task into a pre-training objective, prompt-based methods resolve the data scarce problem effectively. However, previous researches seldom investigate the discrepancy among different strategies on prompt formulation. In this work, we compare two kinds of prompts, name and ontology-based prompts, and reveal how ontology-based prompts exceed its counterpart in event argument extraction. Furthermore, we analyse the potential risk (e.g., biases) in ontology-based prompts via a causal view and propose a debiasing method using causal intervention. Experiments on three benchmarks demonstrate that modified by our debiasing method, the baseline model becomes more robust, with significant improvement in the resistance to adversarial attacks. 1Our code is available at this repository.

Original languageEnglish
Title of host publicationNatural Language Processing and Chinese Computing - 13th National CCF Conference, NLPCC 2024, Proceedings
EditorsDerek F. Wong, Zhongyu Wei, Muyun Yang
PublisherSpringer Science and Business Media Deutschland GmbH
Pages96-108
Number of pages13
ISBN (Print)9789819794331
DOIs
StatePublished - 2025
Event13th CCF International Conference on Natural Language Processing and Chinese Computing, NLPCC 2024 - Hangzhou, China
Duration: 1 Nov 20243 Nov 2024

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume15360 LNAI
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference13th CCF International Conference on Natural Language Processing and Chinese Computing, NLPCC 2024
Country/TerritoryChina
CityHangzhou
Period1/11/243/11/24

Keywords

  • Causal Intervention
  • Event Argument Extraction
  • Prompt Learning

Fingerprint

Dive into the research topics of 'Prompt Debiasing via Causal Intervention for Event Argument Extraction'. Together they form a unique fingerprint.

Cite this