跳到主要导航 跳到搜索 跳到主要内容

Multimodal knowledge graph completion method for addressing imbalance of modal information

  • Ronghua Tian
  • , Hong Yu*
  • , Yaogang Geng
  • , Xiaoling Wang
  • *此作品的通讯作者
  • Chongqing University of Posts and Telecommunications

科研成果: 期刊稿件 › 文章 › 同行评审

摘要

Multimodal Knowledge Graph Completion (MMKGC) focuses on predicting missing triples in multimodal knowledge graphs by effectively leveraging both relational triples and multimodal information. However, existing MMKGC methods often overlook the imbalance of modal information among entities, resulting in an overreliance on the dominant modalities and degrading the performance of completion. To address the problem caused by the modality imbalance, a novel Multimodal Knowledge Graph Completion method (shorted by MI-MKGC) is proposed in this paper. It addresses the problem from two aspects: (1) the relation knowledge-guided dynamic modal fusion module dynamically adjusts the weights of each modality by using the relational types between entities as prior knowledge, and (2) the joint modality adversarial training module generates negative samples to enhance weak modality information. The extensive experimental results on three public datasets with 16 state-of-the-art baselines have verified the advancement of the proposed method. Specially, the metric Hit@1 of MI-MKGC increases by up to 5.2% than that of the best exiting compared method. The implementation code is available at https://github.com/yuhongcqupt/MI-MKGC.

源语言英语
期刊论文编号106
期刊Data Mining and Knowledge Discovery
卷40
期6
DOI
出版状态已出版 - 12月 2026

学术指纹

探究 'Multimodal knowledge graph completion method for addressing imbalance of modal information' 的科研主题。它们共同构成独一无二的学术指纹。

引用此