Modeling Zero-Shot Relation Classification as a Multiple-Choice Problem

Yuquan Lan, Dongxu Li, Yunqi Zhang, Hui Zhao*, Gang Zhao

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

2 Scopus citations

Abstract

Zero-shot relation classification (ZeroRC) aims to infer the semantic relations between entity pairs in sentences, while the relation sets at the training and testing stages are disjoint. It is a crucial task in information extraction and is much more challenging than traditional relation classification. We propose a novel method named MC-BERT to model ZeroRC as a Multiple-Choice problem employing BERT as the backbone model. A semantic template is designed to infuse the information of entities and context. It serves as the question stem of the multiple-choice, followed by a relation label which serves as a choice. Moreover, we propose a grouping strategy to improve training efficiency. We perform comprehensive experiments on two datasets, Wiki-ZSL and FewRel. The results show that our proposed method significantly outperforms previous works. Specifically, it achieves performance gains ranging from 1.17% to 6.87% in the F1 score with only 40% of the model parameters against to state-of-the-art method, demonstrating the simplicity and effectiveness of our proposed method.

Original languageEnglish
Title of host publicationIJCNN 2023 - International Joint Conference on Neural Networks, Proceedings
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9781665488679
DOIs
StatePublished - 2023
Event2023 International Joint Conference on Neural Networks, IJCNN 2023 - Gold Coast, Australia
Duration: 18 Jun 202323 Jun 2023

Publication series

NameProceedings of the International Joint Conference on Neural Networks
Volume2023-June

Conference

Conference2023 International Joint Conference on Neural Networks, IJCNN 2023
Country/TerritoryAustralia
CityGold Coast
Period18/06/2323/06/23

Keywords

  • information extraction
  • natural language processing
  • relation classification
  • zero-shot learning

Fingerprint

Dive into the research topics of 'Modeling Zero-Shot Relation Classification as a Multiple-Choice Problem'. Together they form a unique fingerprint.

Cite this